00000001:02000400:3.0F:1784583639.069361:0:3294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1784583659.789232:0:3515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1784583661.421887:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 847 MB/s 00000001:01000000:1.0F:1784583661.672329:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 971 MB/s 00000001:01000000:3.0:1784583661.921631:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7167 MB/s 00000020:02000000:3.0:1784583662.361437:0:3607:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_ga497ed6 00000400:02000000:0.0F:1784583663.220961:0:3623:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.203.151@tcp [8/256/0/180] 00008000:02000000:3.0:1784583666.694929:0:3772:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784583727.682171:0:5741:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784583742.521836:0:6491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784583742.521841:0:6491:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784583742.521842:0:6491:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784583742.522690:0:6491:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004d85c3e4 00000080:02000400:2.0:1784583742.522704:0:6491:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784583742.542822:0:6491:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784583742.543133:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784583742.543163:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000049c79d6f) 00000020:00000080:2.0:1784583742.543182:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784583742.588842:0:6491:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784583742.588919:0:6491:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1784583742.606803:0:6491:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784583742.607108:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784583742.607116:0:6491:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784583742.607128:0:6491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e47412 00000020:01000004:0.0:1784583742.607134:0:6491:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784583742.607138:0:6491:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784583742.607142:0:6491:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004d85c3e4 from MGS 00000020:01000004:0.0:1784583742.607146:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784583742.607164:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b71ea7fd) 00000020:00000080:0.0:1784583742.607175:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784583742.607239:0:6491:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004d85c3e4 from MGS, refs=2 00080000:01000000:0.0:1784583742.607244:0:6491:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784583742.607249:0:6491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e47420 00000100:00100000:0.0:1784583742.607332:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784583742.607596:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784583742.607603:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784583742.608104:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784583742.608111:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784583742.608806:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784583742.609022:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784583742.609027:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784583742.609672:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784583742.609679:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784583742.610076:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784583742.610082:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784583742.610657:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583742.610661:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583742.610663:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583742.610823:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583742.610825:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583742.610826:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583742.611168:0:6491:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784583742.613636:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784583742.860527:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4255 MB/s 00000001:01000000:1.0:1784583743.110833:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4315 MB/s 00000001:01000000:2.0:1784583743.361580:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 557 MB/s 00000001:01000000:2.0:1784583743.613778:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 911 MB/s 00080000:10000000:2.0:1784583743.618017:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1784583743.625685:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784583743.626212:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784583743.626251:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784583743.626299:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784583743.626419:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784583743.626438:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784583743.626799:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784583743.626926:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784583743.626932:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784583743.627620:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784583743.627627:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784583743.627892:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784583743.627899:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784583743.628374:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784583743.628393:0:6491:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.151@tcp' 00000020:01000004:3.0:1784583743.628395:0:6491:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784583743.628446:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.151@tcp (typ=mgc) 00000020:00000080:3.0:1784583743.628461:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.151@tcp (00000000fba0f8f6) 00000020:00000080:3.0:1784583743.628491:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784583743.628636:0:6491:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df1f36c3@MGC192.168.203.151@tcp: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784583743.628783:0:6491:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.151@tcp-0 is initialized 00000040:01000000:3.0:1784583743.628788:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 1 is initialized 00000100:00080000:2.0:1784583743.629080:0:6509:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784583743.629334:0:6510:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784583743.629646:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.151@tcp (uuid 48a91d92-bcef-47e2-812f-ada1e5d741c7) 00000020:00000080:0.0:1784583743.629714:0:6491:0:(genops.c:1406:class_connect()) connect: client 48a91d92-bcef-47e2-812f-ada1e5d741c7, cookie 0xdab2421a42e4742e 00000100:00080000:0.0:1784583743.629724:0:6491:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784583743.629730:0:6491:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import 00000000df1f36c3 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784583743.629781:0:6491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a6a168c7 x1871271599014016/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784583743.629857:0:6491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS 00000020:01000004:0.0:1784583743.629874:0:6491:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784583743.629879:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784583743.629891:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000049c95314) 00000020:00000080:0.0:1784583743.629901:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784583743.629909:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6a168c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599014016:0@lo:250: 00000100:00100000:3.0:1784583743.629963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.630039:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014016 00000100:00100000:3.0:1784583743.630046:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014016 00000100:00100000:3.0:1784583743.630077:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583743.630083:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c256c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1871271599014016:12345-0@lo:250: 00010000:00080000:3.0:1784583743.630103:0:6506:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 48a91d92-bcef-47e2-812f-ada1e5d741c7@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1784583743.630121:0:6506:0:(genops.c:1406:class_connect()) connect: client 48a91d92-bcef-47e2-812f-ada1e5d741c7, cookie 0xdab2421a42e4743c 00000100:00080000:3.0:1784583743.630225:0:6506:0:(import.c:65:import_set_state_nolock()) 00000000f26d292b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784583743.630271:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c256c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:3638:x1871271599014016:12345-0@lo:250: Request processed in 187us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.630278:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583743.630318:0:3638:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784583743.630325:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1784583743.630332:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784583743.630335:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784583743.630338:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000df1f36c3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784583743.630341:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784583743.630348:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784583743.630351:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6a168c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599014016:0@lo:250: 00000100:00100000:1.0:1784583743.642041:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784583743.642232:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784583743.642239:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784583743.645050:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784583743.645061:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784583743.645568:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784583743.645575:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784583743.650388:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784583743.650592:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784583743.650598:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784583743.651160:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784583743.651168:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:2.0:1784583743.662669:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583743.703292:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784583743.704045:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784583743.704055:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784583743.705147:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784583743.705157:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784583743.705785:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784583743.705951:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784583743.705956:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784583743.706463:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784583743.706501:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784583743.707025:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784583743.707149:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784583743.707153:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784583743.707719:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784583743.707726:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784583743.708578:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784583743.708725:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784583743.708730:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784583743.710244:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784583743.710293:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784583743.727373:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784583743.727782:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784583743.727796:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784583743.729972:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784583743.729985:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784583743.730777:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784583743.730786:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784583743.731823:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784583743.731850:0:6491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784583743.731855:0:6491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784583743.731947:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784583743.731977:0:6491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784583743.731982:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784583743.731983:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784583743.731985:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583743.731986:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583743.731987:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583743.731988:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583743.731990:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784583743.731991:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784583743.731992:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583743.731994:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583743.731995:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583743.731997:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784583743.731999:0:6491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784583743.732001:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784583743.732002:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784583743.732003:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583743.732004:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583743.732005:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583743.732006:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583743.732007:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784583743.732008:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784583743.732009:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583743.732009:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583743.732010:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583743.732011:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784583743.732050:0:6491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784583743.732066:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001faedb4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014144:0@lo:253: 00000100:00100000:2.0:1784583743.732141:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.732189:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021614a29 going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.732439:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014144 00000100:00100000:3.0:1784583743.732446:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014144 00000100:00100000:3.0:1784583743.732520:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784583743.732528:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d536e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6491:x1871271599014144:12345-0@lo:253: 20000000:01000000:3.0:1784583743.732581:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784583743.732584:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1784583743.735100:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784583743.735157:0:6508:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1784583743.735805:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784583743.737055:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1784583743.737264:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784583743.737268:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1784583743.737272:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1784583743.737276:0:6508:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1784583743.737286:0:6508:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1784583743.738660:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583743.738835:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1784583743.738986:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784583743.739007:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1784583743.739022:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1784583743.739036:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1784583743.739098:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1784583743.739105:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1784583743.739118:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1784583743.739123:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1784583743.739135:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1784583743.739140:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1784583743.739151:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1784583743.739164:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1784583743.739190:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784583743.739195:0:6508:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1784583743.739201:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583743.739291:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1784583743.739301:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784583743.739316:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1784583743.739345:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1784583743.739434:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1784583743.739443:0:6508:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1784583743.739610:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1784583743.739619:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784583743.739633:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1784583743.739659:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1784583743.739673:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1784583743.739682:0:6508:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1784583743.739706:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1784583743.739713:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1784583743.739725:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1784583743.739738:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1784583743.739792:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1784583743.739815:0:6508:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1784583743.739820:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1784583743.740428:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784583743.740923:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784583743.740945:0:6508:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.151@tcp for mdt 20000000:01000000:2.0:1784583743.740947:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583743.740962:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784583743.740968:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784583743.741141:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784583743.741152:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583743.741169:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784583743.741177:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784583743.741190:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784583743.741206:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784583743.741235:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784583743.741238:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784583743.741241:0:6508:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784583743.741400:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784583743.741403:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784583743.743393:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1784583743.746158:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1784583743.746195:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1784583743.746210:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1784583743.746221:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784583743.746224:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784583743.747448:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1784583743.749049:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1784583743.749081:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1784583743.749094:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1784583743.749108:0:6508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784583743.749120:0:6508:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1784583743.749127:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784583743.749130:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784583743.749135:0:6508:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784583743.749141:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784583743.749809:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1784583743.750093:0:6508:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784583743.763384:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784583743.763429:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784583743.763439:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784583743.763466:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784583743.763553:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763576:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763587:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763593:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763620:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763627:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763633:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008002e4e8 already unused, calling callback (000000004f9daade) 00010000:00010000:3.0:1784583743.763637:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763645:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763659:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763666:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.763671:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008002e4e8/0xdab2421a42e47443 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784583743.763694:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784583743.775693:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d536e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6491:x1871271599014144:12345-0@lo:253: Request processed in 43158us (43544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.775707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784583743.775788:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001faedb4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014144:0@lo:253: 10000000:01000000:2.0:1784583743.775804:0:6491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784583743.775808:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784583743.775810:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784583743.775811:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583743.775812:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784583743.775813:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583743.775814:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583743.775816:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784583743.775817:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784583743.775818:0:6491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784583743.775819:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583743.775821:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784583743.775839:0:6491:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004d85c3e4 from lustre-MDT0000 10000000:01000000:2.0:1784583743.775935:0:6491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784583743.775939:0:6491:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784583743.775943:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98b4331acd40 10000000:01000000:2.0:1784583743.775947:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784583743.775955:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b4331acd40 from 1 10000000:01000000:2.0:1784583743.775958:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784583743.775993:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.776005:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.776028:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.776045:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001faedb4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014272:0@lo:101: 00000100:00100000:2.0:1784583743.776079:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.776160:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bc45b4a going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.776224:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014272 00000100:00100000:3.0:1784583743.776230:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014272 00000100:00100000:3.0:1784583743.776294:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784583743.776303:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074607d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6491:x1871271599014272:12345-0@lo:101: 00010000:00010000:3.0:1784583743.776319:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583743.776331:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4744a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.776351:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4744a expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.776360:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4744a expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.776368:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003610a6f6, rc 0) 00000100:00100000:3.0:1784583743.776406:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074607d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6491:x1871271599014272:12345-0@lo:101: Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.776412:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583743.776488:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001faedb4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014272:0@lo:101: 00010000:00010000:0.0:1784583743.776511:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.776521:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583743.776581:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014400:0@lo:501: 00000100:00100000:0.0:1784583743.776605:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583743.776750:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2b5eaf8 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.776782:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014400 00000100:00100000:2.0:1784583743.776787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014400 00000100:00100000:2.0:1784583743.776809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583743.776816:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dccabd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6491:x1871271599014400:12345-0@lo:501: 00000100:00100000:2.0:1784583743.777037:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dccabd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6491:x1871271599014400:12345-0@lo:501: Request processed in 220us (431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784583743.777044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784583743.777106:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014400:0@lo:501: 10000000:01000000:0.0:1784583743.777132:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784583743.777177:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.777186:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583743.777194:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b418942800 10000000:01000000:0.0:1784583743.777197:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784583743.777201:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b418942800 10000000:01000000:0.0:1784583743.777210:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784583743.777213:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b418942800 from 1 10000000:01000000:0.0:1784583743.777214:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784583743.777230:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.777237:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.777243:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583743.777254:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014528:0@lo:101: 00000100:00100000:0.0:1784583743.777277:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583743.777299:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2b5eaf8 going to sleep for 11 seconds 00000100:00100000:1.0:1784583743.777356:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014528 00000100:00100000:1.0:1784583743.777361:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014528 00000100:00100000:1.0:1784583743.777400:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784583743.777405:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c8afa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6491:x1871271599014528:12345-0@lo:101: 00010000:00010000:1.0:1784583743.777413:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583743.777422:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071527049/0xdab2421a42e4745f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47458 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.777435:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071527049/0xdab2421a42e4745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47458 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.777442:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071527049/0xdab2421a42e4745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47458 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.777448:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071527049, rc 0) 00000100:00100000:1.0:1784583743.777568:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c8afa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6491:x1871271599014528:12345-0@lo:101: Request processed in 161us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583743.777573:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784583743.777718:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014528:0@lo:101: 00010000:00010000:0.0:1784583743.777728:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.777736:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583743.777747:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784583743.777787:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.777795:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000634a44f7/0xdab2421a42e47458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583743.777800:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784583743.777852:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784583743.777859:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b418942800 10000000:01000000:1.0:1784583743.777862:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784583743.777871:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784583743.777873:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784583743.777899:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.777907:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.777923:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583743.777936:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014656:0@lo:101: 00000100:00100000:1.0:1784583743.777963:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583743.777991:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a68ddbd going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.778027:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014656 00000100:00100000:3.0:1784583743.778032:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014656 00000100:00100000:3.0:1784583743.778063:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784583743.778070:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd65d3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6491:x1871271599014656:12345-0@lo:101: 00010000:00010000:3.0:1784583743.778077:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583743.778085:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47466 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.778100:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47466 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.778108:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47466 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.778114:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d76d83af, rc 0) 00000100:00100000:3.0:1784583743.778155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd65d3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+8:6491:x1871271599014656:12345-0@lo:101: Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.778161:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583743.778184:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014656:0@lo:101: 00010000:00010000:1.0:1784583743.778197:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.778205:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583743.778246:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014784:0@lo:501: 00000100:00100000:1.0:1784583743.778269:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583743.778354:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a68ddbd going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.778367:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014784 00000100:00100000:2.0:1784583743.778372:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014784 00000100:00100000:2.0:1784583743.778403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784583743.778408:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aedc7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+8:6491:x1871271599014784:12345-0@lo:501: 00000100:00100000:2.0:1784583743.778604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aedc7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6491:x1871271599014784:12345-0@lo:501: Request processed in 195us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.778613:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784583743.778635:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014784:0@lo:501: 00000100:00100000:1.0:1784583743.778661:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014912:0@lo:503: 00000100:00100000:1.0:1784583743.778697:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583743.778718:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a68ddbd going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.778730:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599014912 00000100:00100000:3.0:1784583743.778735:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599014912 00000100:00100000:3.0:1784583743.778767:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784583743.778772:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036ca175e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6491:x1871271599014912:12345-0@lo:503: 00000100:00100000:1.0:1784583743.778873:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599014912:0@lo:503: 00000100:00100000:3.0:1784583743.779179:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036ca175e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6491:x1871271599014912:12345-0@lo:503: Request processed in 406us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.779186:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784583743.779355:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6536:1871271599015040:0@lo:502: 00000100:00100000:1.0:1784583743.779387:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583743.779436:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b197e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.779565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015040 00000100:00100000:2.0:1784583743.779569:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015040 00000100:00100000:2.0:1784583743.779632:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784583743.779639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6123c8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6536:x1871271599015040:12345-0@lo:502: 00000100:00100000:2.0:1784583743.779720:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6123c8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6536:x1871271599015040:12345-0@lo:502: Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.779735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784583743.779797:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002af36f8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6536:1871271599015040:0@lo:502: 00000020:01000000:0.0:1784583743.779818:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583743.779827:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583743.779829:0:6536:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784583743.779833:0:6536:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784583743.779836:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784583743.779848:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d60aef18) 00000020:00000080:0.0:1784583743.779873:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784583743.779878:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784583743.779951:0:6536:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784583743.779958:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e4747b 00000020:00000080:0.0:1784583743.780145:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784583743.780150:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583743.780152:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583743.780153:0:6536:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784583743.780155:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583743.780157:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583743.780158:0:6536:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784583743.780160:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784583743.780165:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000448fb868) 00000020:00000080:0.0:1784583743.780171:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784583743.780174:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784583743.780175:0:6536:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784583743.780177:0:6536:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784583743.780180:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784583743.780214:0:6536:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004d85c3e4 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784583743.780226:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c3775235) 00000020:00000080:0.0:1784583743.780230:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784583743.780278:0:6536:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784583743.780281:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e47490 00000020:00000080:0.0:1784583743.780380:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784583743.780387:0:6536:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784583743.780396:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdab2421a42e47497 00080000:01000000:0.0:1784583743.780400:0:6536:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784583743.780403:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e4749e 00080000:10000000:0.0:1784583743.780816:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1784583743.780901:0:6536:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1784583743.783337:0:6536:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784583743.874640:0:6536:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784583743.874938:0:6536:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784583743.886036:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784583743.886445:0:6536:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784583743.900356:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d5ddb0cb) 00000020:00000080:3.0:1784583743.900379:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784583743.900566:0:6536:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784583743.900583:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e474ac 00000020:00000080:1.0:1784583743.902588:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1784583743.903660:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1784583743.906286:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1784583743.909153:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1784583743.932882:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1784583743.934743:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1784583743.937708:0:6536:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1784583743.943147:0:6536:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdab2421a42e474b3 00000020:00000080:1.0:1784583743.943430:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784583743.943442:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583743.943448:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583743.943450:0:6536:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784583743.943453:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583743.943457:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583743.943458:0:6536:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784583743.943461:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784583743.943463:0:6536:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784583743.943588:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583743.943593:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583743.943595:0:6536:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784583743.943597:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583743.943602:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583743.943603:0:6536:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784583743.943607:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784583743.943641:0:6536:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1784583743.943693:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007cba5fbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6536:1871271599015168:0@lo:502: 00000100:00100000:1.0:1784583743.943772:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583743.943966:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 00000000678ceeef going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.944421:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015168 00000100:00100000:2.0:1784583743.944430:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015168 00000100:00100000:2.0:1784583743.944522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784583743.944531:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b18934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6536:x1871271599015168:12345-0@lo:502: 00000100:00100000:2.0:1784583743.944650:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b18934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6536:x1871271599015168:12345-0@lo:502: Request processed in 121us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.944658:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784583743.944898:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007cba5fbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6536:1871271599015168:0@lo:502: 00000020:01000000:0.0:1784583743.944928:0:6536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583743.945040:0:6536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583743.945043:0:6536:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1784583743.945048:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1784583743.945205:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1784583743.945226:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784583743.945245:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.945256:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583743.945263:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b418942800 from 1 10000000:01000000:2.0:1784583743.945266:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583743.945294:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.945300:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.945308:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.945334:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009159c1ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015296:0@lo:101: 00000100:00100000:2.0:1784583743.945367:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.945401:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000004533e489 going to sleep for 11 seconds 00000100:00100000:0.0:1784583743.945605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015296 00000100:00100000:0.0:1784583743.945611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015296 00000100:00100000:0.0:1784583743.945637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784583743.945643:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98d8a16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:6491:x1871271599015296:12345-0@lo:101: 00010000:00010000:0.0:1784583743.945653:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583743.945665:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e474ba expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.945684:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e474ba expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.945693:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474ba expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.945702:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b66f7864, rc 0) 00000100:00100000:0.0:1784583743.945735:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98d8a16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:6491:x1871271599015296:12345-0@lo:101: Request processed in 92us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583743.945741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784583743.946237:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009159c1ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015296:0@lo:101: 00010000:00010000:2.0:1784583743.946251:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.946260:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.946813:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009159c1ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015424:0@lo:256: 00000100:00100000:2.0:1784583743.946867:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.946897:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 000000004533e489 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.946918:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015424 00000100:00100000:2.0:1784583743.946923:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015424 00000100:00100000:2.0:1784583743.947252:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784583743.947260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378b117f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:6491:x1871271599015424:12345-0@lo:256: 20000000:01000000:2.0:1784583743.947276:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784583743.947281:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784583743.947348:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378b117f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:6491:x1871271599015424:12345-0@lo:256: Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.947355:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784583743.947683:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009159c1ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015424:0@lo:256: 10000000:01000000:3.0:1784583743.948410:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784583743.948423:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.948432:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583743.948439:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b418942800 from 1 10000000:01000000:3.0:1784583743.948441:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583743.948531:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.948550:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.948559:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583743.948574:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015552:0@lo:101: 00000100:00100000:3.0:1784583743.948619:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.948647:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000773e3db0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.948825:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015552 00000100:00100000:2.0:1784583743.948831:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015552 00000100:00100000:2.0:1784583743.948871:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784583743.948878:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003629c837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:6491:x1871271599015552:12345-0@lo:101: 00010000:00010000:2.0:1784583743.948898:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583743.948911:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e474c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.948929:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.949087:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.949095:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041a0384e, rc 0) 00000100:00100000:2.0:1784583743.949137:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003629c837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015552:12345-0@lo:101: Request processed in 260us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.949144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784583743.949321:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015552:0@lo:101: 00010000:00010000:3.0:1784583743.949332:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.949340:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583743.949393:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015680:0@lo:501: 00000100:00100000:3.0:1784583743.949417:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.949438:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000773e3db0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.949654:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015680 00000100:00100000:2.0:1784583743.949659:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015680 00000100:00100000:2.0:1784583743.949690:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784583743.949696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045cb1335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015680:12345-0@lo:501: 00000100:00100000:2.0:1784583743.949840:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045cb1335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015680:12345-0@lo:501: Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.949847:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583743.950117:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015680:0@lo:501: 00000100:00100000:3.0:1784583743.950157:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015808:0@lo:503: 00000100:00100000:3.0:1784583743.950191:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.950216:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000773e3db0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583743.950261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015808 00000100:00100000:0.0:1784583743.950271:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015808 00000100:00100000:0.0:1784583743.950302:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784583743.950308:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a88857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015808:12345-0@lo:503: 00000040:00080000:0.0:1784583743.950335:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784583743.950374:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a88857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015808:12345-0@lo:503: Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583743.950380:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583743.950644:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015808:0@lo:503: 00000040:00080000:1.0:1784583743.951757:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784583743.954768:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784583743.954808:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784583743.954918:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.954940:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583743.955017:0:6491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784583743.955019:0:6491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b418942800 10000000:01000000:2.0:1784583743.955023:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b418942800 10000000:01000000:2.0:1784583743.955026:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784583743.955032:0:6491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b418942800 from 1 10000000:01000000:2.0:1784583743.955034:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784583743.955067:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.955075:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.955084:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.955104:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a2d0553 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015936:0@lo:101: 00000100:00100000:2.0:1784583743.955168:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.955214:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096006e49 going to sleep for 11 seconds 00000100:00100000:0.0:1784583743.955307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599015936 00000100:00100000:0.0:1784583743.955314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599015936 00000100:00100000:0.0:1784583743.955360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784583743.955369:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c05bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6491:x1871271599015936:12345-0@lo:101: 00010000:00010000:0.0:1784583743.955380:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583743.955392:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e474d6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.955412:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.955421:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583743.955430:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d34f5042, rc 0) 00000100:00100000:0.0:1784583743.955499:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c05bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599015936:12345-0@lo:101: Request processed in 131us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583743.955515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784583743.955687:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a2d0553 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599015936:0@lo:101: 00010000:00010000:2.0:1784583743.955699:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.955707:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.955753:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a2d0553 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016064:0@lo:501: 00000100:00100000:2.0:1784583743.955776:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.955920:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096006e49 going to sleep for 11 seconds 00000100:00100000:1.0:1784583743.958177:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016064 00000100:00100000:1.0:1784583743.958192:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016064 00000100:00100000:2.0:1784583743.958309:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784583743.958318:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be9965a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016064:12345-0@lo:501: 00000100:00100000:2.0:1784583743.958626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be9965a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016064:12345-0@lo:501: Request processed in 310us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583743.958633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583743.958750:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a2d0553 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016064:0@lo:501: 00000100:00100000:3.0:1784583743.958808:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016192:0@lo:503: 00000100:00100000:3.0:1784583743.958921:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.960643:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000773e3db0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583743.960787:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016192 00000100:00100000:2.0:1784583743.960797:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016192 00000100:00100000:1.0:1784583743.961274:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784583743.961286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b2230c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016192:12345-0@lo:503: 00000100:00100000:1.0:1784583743.961417:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b2230c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016192:12345-0@lo:503: Request processed in 134us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583743.961423:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784583743.961816:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016192:0@lo:503: 00000100:00100000:0.0:1784583743.962891:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6541:1871271599016320:0@lo:502: 00000100:00100000:0.0:1784583743.962960:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583743.963003:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c1e33c05 going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.963108:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016320 00000100:00100000:3.0:1784583743.963115:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016320 00000100:00100000:3.0:1784583743.963156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784583743.963164:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bdd2f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6541:x1871271599016320:12345-0@lo:502: 00000100:00100000:3.0:1784583743.963260:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bdd2f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6541:x1871271599016320:12345-0@lo:502: Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.963267:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784583743.963436:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6541:1871271599016320:0@lo:502: 00000020:01000004:0.0:1784583743.963517:0:6541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784583743.963532:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008063722f) 00000020:00000080:0.0:1784583743.963549:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784583743.963710:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004d85c3e4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784583743.963715:0:6541:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004d85c3e4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784583743.963717:0:6541:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004d85c3e4 4 00010000:00080000:0.0:1784583743.963740:0:6541:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000333c424d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784583743.965927:0:6541:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784583743.966029:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784583743.966068:0:6541:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784583743.966080:0:6541:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdab2421a42e474eb 00000100:00080000:0.0:1784583743.966089:0:6541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784583743.966093:0:6541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000333c424d using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784583743.966128:0:6541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dfd887bb x1871271599016448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784583743.966172:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599016448:0@lo:38: 00000100:00100000:0.0:1784583743.966235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784583743.966276:0:6541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784583743.975672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016448 00000100:00100000:1.0:1784583743.975687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016448 00000100:00100000:1.0:1784583743.975737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583743.975743:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6f8dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599016448:12345-0@lo:38: 00000100:00100000:1.0:1784583743.975832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6f8dd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599016448:12345-0@lo:38: Request processed in 88us (9598us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784583743.975839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583743.975890:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784583743.975897:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000333c424d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784583743.975901:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784583743.975904:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfd887bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599016448:0@lo:38: 00000100:00100000:0.0:1784583743.977696:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000242be265 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6541:1871271599016576:0@lo:502: 00000100:00100000:0.0:1784583743.977769:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583743.977800:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016576 00000100:00100000:0.0:1784583743.977806:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016576 00000100:00100000:0.0:1784583743.977840:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784583743.977846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006db0e9d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6541:x1871271599016576:12345-0@lo:502: 00000100:00100000:0.0:1784583743.980297:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006db0e9d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6541:x1871271599016576:12345-0@lo:502: Request processed in 2448us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583743.980309:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784583743.980385:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c1e33c05 going to sleep for 11 seconds 00000100:00100000:0.0:1784583743.980407:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000242be265 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:6541:1871271599016576:0@lo:502: 00000040:00080000:0.0:1784583743.980437:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1784583743.984083:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1784583743.984125:0:6491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784583743.984141:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.984154:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784583743.984213:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784583743.984215:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784583743.984216:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784583743.984217:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784583743.984218:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784583743.984220:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784583743.984221:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784583743.984222:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784583743.984223:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784583743.984224:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784583743.984226:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784583743.984232:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784583743.984235:0:6491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1784583743.984237:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784583743.984238:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784583743.984239:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784583743.984240:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784583743.984241:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784583743.984242:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784583743.984243:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784583743.984243:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784583743.984245:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784583743.984245:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784583743.984246:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784583743.984247:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784583743.984272:0:6491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784583743.984290:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016704:0@lo:253: 00000100:00100000:3.0:1784583743.984361:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583743.984393:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e28c7ab6 going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.984423:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016704 00000100:00100000:3.0:1784583743.984429:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016704 00000100:00100000:3.0:1784583743.984484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583743.984493:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b83f8ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016704:12345-0@lo:253: 20000000:01000000:3.0:1784583743.984534:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784583743.984548:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784583743.998075:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784583743.998098:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784583743.998266:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784583743.998272:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784583743.998291:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.998310:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.998318:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.998354:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583743.998367:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583743.998381:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000063a05c14 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599016832:0@lo:104: 00000100:00100000:2.0:1784583743.998442:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583743.998540:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set 00000000517f71be going to sleep for 11 seconds 00000100:00100000:3.0:1784583743.998671:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016832 00000100:00100000:3.0:1784583743.998678:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016832 00000100:00100000:3.0:1784583743.998730:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583743.998737:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086053e6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599016832:12345-0@lo:104: 00010000:00010000:3.0:1784583743.998749:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583743.998810:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583743.998816:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086053e6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599016832:12345-0@lo:104: Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583743.998837:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784583743.998935:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583743.998940:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.998949:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e09c1b52 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:1.0:1784583743.998951:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.998966:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583743.998972:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583743.998976:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583743.999009:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.999015:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583743.999028:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.999034:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e474ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583743.999049:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583743.999050:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583743.999051:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583743.999168:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d324a443 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599016960:0@lo:103: 00000100:00100000:0.0:1784583743.999195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583743.999238:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000063a05c14 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599016832:0@lo:104: 00010000:00010000:0.0:1784583743.999253:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583743.999339:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b83f8ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6491:x1871271599016704:12345-0@lo:253: Request processed in 14847us (14978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583743.999347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784583743.999414:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c1b1c34 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:6491:1871271599016704:0@lo:253: 10000000:01000000:0.0:1784583743.999423:0:6491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784583743.999426:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784583743.999428:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784583743.999430:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583743.999431:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784583743.999432:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583743.999433:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583743.999434:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784583743.999435:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784583743.999436:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784583743.999438:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784583743.999439:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583743.999440:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784583743.999448:0:6491:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784583744.000695:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599016960 00000100:00100000:3.0:1784583744.000705:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599016960 00010000:00010000:3.0:1784583744.000735:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583744.000775:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583744.000783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000242be265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3640:x1871271599016960:12345-0@lo:103: 00010000:00010000:3.0:1784583744.000796:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583744.000801:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000809:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000824:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b66f7864/0xdab2421a42e474c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e474ba expref: 12 pid: 6506 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000841:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000857:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784583744.000872:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002601373s 00010000:00010000:3.0:1784583744.000876:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000881:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000901:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000906:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000912:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006104beac already unused, calling callback (000000004f9daade) 00010000:00010000:3.0:1784583744.000915:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000922:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000942:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583744.000953:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583744.001003:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000242be265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:3640:x1871271599016960:12345-0@lo:103: Request processed in 221us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583744.001010:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784583744.002028:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583744.002040:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583744.002045:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006104beac/0xdab2421a42e474f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583744.008625:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d324a443 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599016960:0@lo:103: 00080000:10000000:0.0:1784583744.014150:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1784583744.014324:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784583744.014794:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1784583744.016090:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784583744.016309:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1784583744.027825:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1784583744.032685:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1784583744.032913:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1784583744.033313:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1784583744.033602:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1784583744.033810:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1784583744.033971:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1784583744.036460:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784583744.070341:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1784583744.070429:0:6546:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1784583744.070433:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784583744.071201:0:6547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:3.0:1784583744.079359:0:6547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1784583744.082144:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784583744.082262:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784583744.084243:0:6491:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784583744.084258:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784583744.084461:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784583744.089072:0:6547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784583744.089165:0:6547:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784583744.089170:0:6547:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1784583744.091808:0:6491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784583744.092347:0:6491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784583744.092384:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784583744.098193:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784583744.098453:0:6491:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1784583744.100709:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784583744.104625:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784583744.105054:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784583744.105189:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1784583744.105319:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784583744.107628:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1784583744.107846:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1784583744.108995:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784583744.109122:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1784583744.109237:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1784583744.109700:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1784583744.109835:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1784583744.110128:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1784583744.110267:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1784583744.110437:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1784583744.113298:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1784583744.116051:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1784583744.116418:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1784583744.117217:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1784583744.117631:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1784583744.117765:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1784583744.118046:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1784583744.118181:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1784583744.118314:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1784583744.119345:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1784583744.120247:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1784583744.123822:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1784583744.126055:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1784583744.126230:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1784583744.127699:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1784583744.128710:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1784583744.129761:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1784583744.130748:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1784583744.142350:0:6491:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784583744.142403:0:6491:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb9d41c7b988 00100000:10000000:2.0:1784583744.142411:0:6491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784583744.148076:0:6491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784583744.148092:0:6491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784583744.148111:0:6491:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784583744.148129:0:6491:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784583744.149025:0:6491:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583744.149188:0:6491:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784583744.686724:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583745.714513:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583746.734225:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583747.758412:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784583748.650252:0:6792:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784583748.785441:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784583749.294723:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784583749.294729:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b418942800 from 3 10000000:01000000:3.0:1784583749.294733:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784583749.294769:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.294780:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.294789:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583749.294809:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599017088:0@lo:101: 00000100:00100000:3.0:1784583749.294868:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583749.294923:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000001badaa56 going to sleep for 11 seconds 00000100:00100000:3.0:1784583749.294957:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017088 00000100:00100000:3.0:1784583749.294963:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017088 00000100:00100000:3.0:1784583749.295004:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583749.295011:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004142f6f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:6510:x1871271599017088:12345-0@lo:101: 00010000:00010000:3.0:1784583749.295024:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583749.295037:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e474f9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.295066:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.295075:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.295084:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a495f360, rc 0) 00000100:00100000:3.0:1784583749.295120:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004142f6f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6510:x1871271599017088:12345-0@lo:101: Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583749.295127:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583749.295183:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599017088:0@lo:101: 00010000:00010000:3.0:1784583749.295195:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.295203:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583749.295243:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599017216:0@lo:256: 00000100:00100000:3.0:1784583749.295269:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583749.295284:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000001badaa56 going to sleep for 11 seconds 00000100:00100000:3.0:1784583749.295296:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017216 00000100:00100000:3.0:1784583749.295299:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017216 00000100:00100000:3.0:1784583749.295320:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784583749.295326:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d94f19e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6510:x1871271599017216:12345-0@lo:256: 20000000:01000000:3.0:1784583749.295339:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784583749.295353:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784583749.295356:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784583749.295430:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d94f19e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:6510:x1871271599017216:12345-0@lo:256: Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583749.295436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784583749.295497:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599017216:0@lo:256: 10000000:01000000:3.0:1784583749.295533:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784583749.295538:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583749.295544:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784583749.296057:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784583749.296062:0:473:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784583749.296064:0:473:0:(import.c:65:import_set_state_nolock()) 00000000333c424d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784583749.296071:0:473:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000333c424d using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784583749.296090:0:473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003da283ea x1871271599017344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583749.296121:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599017344:0@lo:38: 00000100:00100000:3.0:1784583749.296165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583749.298239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017344 00000100:00100000:0.0:1784583749.298251:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017344 00000100:00100000:0.0:1784583749.298289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784583749.298295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ef5164 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599017344:12345-0@lo:38: 00010000:00080000:0.0:1784583749.298319:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1784583749.298361:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdab2421a42e47507 00000004:00100000:0.0:1784583749.298401:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784583749.298534:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000fa9c8206 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784583749.298601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ef5164 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1871271599017344:12345-0@lo:38: Request processed in 306us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583749.298609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784583749.298775:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003da283ea x1871271599017344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784583749.298791:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784583749.298797:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784583749.298801:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784583749.298803:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000333c424d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583749.298808:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599017344:0@lo:38: 00000020:00000004:1.0:1784583749.727612:0:6844:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784583749.728229:0:6844:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784583749.806682:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583750.832827:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583751.854333:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784583752.468839:0:6945:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583752.469054:0:6945:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784583752.877750:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583753.901910:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583754.414742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599017472:0@lo:400: 00000100:00100000:1.0:1784583754.414818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583754.414977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017472 00000100:00100000:0.0:1784583754.414985:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017472 00000100:00100000:0.0:1784583754.415029:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784583754.415037:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005487a113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3641:x1871271599017472:12345-0@lo:400: 00000100:00100000:2.0:1784583754.418279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f52fa10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599017600:0@lo:400: 00000100:00100000:2.0:1784583754.418349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583754.420960:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005487a113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3641:x1871271599017472:12345-0@lo:400: Request processed in 5916us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583754.420975:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784583754.423641:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003da283ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599017472:0@lo:400: 00000100:00100000:3.0:1784583754.424355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017600 00000100:00100000:3.0:1784583754.424365:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017600 00000100:00100000:3.0:1784583754.424423:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583754.424444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b00f5eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599017600:12345-0@lo:400: 00000100:00100000:3.0:1784583754.424544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b00f5eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599017600:12345-0@lo:400: Request processed in 113us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583754.424550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784583754.424583:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f52fa10 x1871271599017600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583754.424593:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f52fa10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599017600:0@lo:400: 00010000:00010000:2.0:1784583754.928827:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583755.960048:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583756.979764:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583757.997929:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583759.023737:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583759.539421:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f52fa10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599017728:0@lo:400: 00000100:00100000:2.0:1784583759.539612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583759.539712:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017728 00000100:00100000:0.0:1784583759.539720:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017728 00000100:00100000:0.0:1784583759.539771:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784583759.539777:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000490673ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3639:x1871271599017728:12345-0@lo:400: 00000100:00100000:0.0:1784583759.540418:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000490673ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3639:x1871271599017728:12345-0@lo:400: Request processed in 639us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583759.540428:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784583759.540583:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b0df669 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599017856:0@lo:400: 00000100:00100000:1.0:1784583759.540618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583759.540711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017856 00000100:00100000:3.0:1784583759.540718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017856 00000100:00100000:2.0:1784583759.540813:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f52fa10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599017728:0@lo:400: 00000100:00100000:3.0:1784583759.541070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784583759.541094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bd26cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599017856:12345-0@lo:400: 00000100:00100000:3.0:1784583759.541149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bd26cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599017856:12345-0@lo:400: Request processed in 61us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583759.541156:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784583759.541232:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008b0df669 x1871271599017856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583759.541244:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b0df669 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599017856:0@lo:400: 00010000:00010000:0.0:1784583760.045630:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583761.072329:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.094947:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784583762.250346:0:7443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784583762.250351:0:7443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784583762.250352:0:7443:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784583762.250704:0:7443:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b989d2d9 00000020:01000004:0.0:1784583762.250719:0:7443:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1784583762.250739:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784583762.250752:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009610b35b) 00000020:00000080:0.0:1784583762.250769:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784583762.308604:0:7443:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1784583762.308673:0:7443:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1784583762.380235:0:7443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784583762.380504:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1784583762.380515:0:7443:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784583762.380528:0:7443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47515 00000020:01000004:1.0:1784583762.380535:0:7443:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784583762.380571:0:7443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784583762.380580:0:7443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784583762.380587:0:7443:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1784583762.380627:0:7443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1784583762.380632:0:7443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1784583762.410115:0:7443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784583762.410155:0:7443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1784583762.410159:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784583762.410161:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784583762.410162:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583762.410163:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784583762.410164:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583762.410165:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583762.410166:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784583762.410167:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784583762.410169:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784583762.410170:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583762.410171:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784583762.410174:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1784583762.410177:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784583762.410178:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784583762.410179:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583762.410180:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784583762.410181:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583762.410182:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583762.410183:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784583762.410184:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784583762.410190:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784583762.410191:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583762.410192:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784583762.410217:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784583762.410233:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010c3c326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599017984:0@lo:253: 00000100:00100000:0.0:1784583762.410390:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.410517:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000285b1f52 going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.410744:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599017984 00000100:00100000:3.0:1784583762.410752:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599017984 00000100:00100000:3.0:1784583762.410827:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583762.410836:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d117599f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599017984:12345-0@lo:253: 20000000:01000000:3.0:1784583762.410875:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784583762.410879:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1784583762.410884:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1784583762.410886:0:6508:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1784583762.410929:0:6508:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1784583762.411102:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784583762.411221:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784583762.411235:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784583762.411251:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1784583762.411278:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1784583762.411294:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1784583762.411344:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1784583762.411352:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1784583762.411365:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1784583762.411370:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1784583762.411380:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1784583762.411395:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1784583762.411408:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1784583762.411422:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1784583762.411889:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1784583762.411901:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:3.0:1784583762.411915:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1784583762.411921:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784583762.411932:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1784583762.411937:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:3.0:1784583762.411949:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1784583762.411955:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784583762.411967:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1784583762.411983:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1784583762.411993:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1784583762.412082:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1784583762.412090:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1784583762.412101:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1784583762.412114:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1784583762.412138:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1784583762.412145:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1784583762.412156:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1784583762.412171:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1784583762.412176:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1784583762.412194:0:6508:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784583762.412200:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1784583762.412734:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1784583762.412928:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1784583762.412947:0:6508:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.151@tcp for mdt 20000000:01000000:1.0:1784583762.412949:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1784583762.412961:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1784583762.412968:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784583762.412980:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1784583762.412985:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1784583762.413001:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1784583762.413008:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1784583762.413020:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1784583762.413034:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1784583762.413079:0:6508:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1784583762.413086:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1784583762.413429:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1784583762.413576:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1784583762.413591:0:6508:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.151@tcp for mdt 20000000:01000000:1.0:1784583762.413593:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1784583762.413608:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1784583762.413614:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784583762.413646:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1784583762.413652:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1784583762.413666:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1784583762.413673:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1784583762.413685:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1784583762.413700:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1784583762.413719:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784583762.413722:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784583762.413733:0:6508:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784583762.413777:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784583762.413780:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784583762.414103:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1784583762.414121:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1784583762.414135:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1784583762.414269:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1784583762.414288:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1784583762.414301:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1784583762.414309:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784583762.414310:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784583762.414708:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784583762.414730:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784583762.414744:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1784583762.414859:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1784583762.414878:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784583762.414899:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784583762.414972:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784583762.414974:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784583762.415427:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784583762.415447:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784583762.415459:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1784583762.419844:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1784583762.419875:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1784583762.419893:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1784583762.419920:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784583762.419923:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784583762.419927:0:6508:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784583762.419933:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784583762.420362:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1784583762.421514:0:6508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784583762.443722:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784583762.449603:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449628:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4744a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449635:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47466 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449641:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449647:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449695:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.449710:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.449724:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f66cd169 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018112:0@lo:104: 00000100:00100000:0.0:1784583762.450048:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583762.450202:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.450229:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 12 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.450238:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ffca584b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018240:0@lo:104: 00000100:00100000:0.0:1784583762.450274:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583762.451323:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.451336:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 12 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.451347:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018368:0@lo:104: 00000100:00100000:0.0:1784583762.451392:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.452457:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018112 00000100:00100000:2.0:1784583762.452486:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018112 00000100:00100000:2.0:1784583762.452537:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018240 00000100:00100000:2.0:1784583762.452540:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018240 00000100:00100000:2.0:1784583762.452555:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784583762.452562:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043587dc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599018112:12345-0@lo:104: 00010000:00010000:2.0:1784583762.452576:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.452650:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583762.452655:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043587dc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599018112:12345-0@lo:104: Request processed in 94us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.452662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784583762.452679:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784583762.452684:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ba5f85e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599018240:12345-0@lo:104: 00010000:00010000:2.0:1784583762.452691:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.452825:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583762.452830:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ba5f85e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599018240:12345-0@lo:104: Request processed in 146us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.452836:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583762.452961:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d745d7e2 going to sleep for 11 seconds 00000100:00100000:0.0:1784583762.452983:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f66cd169 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018112:0@lo:104: 00000100:00100000:0.0:1784583762.452992:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ffca584b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018240:0@lo:104: 00010000:00010000:1.0:1784583762.456135:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784583762.456148:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456160:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016042a67 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:1.0:1784583762.456163:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456173:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583762.456200:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583762.456206:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583762.456373:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456379:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583762.456414:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456420:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 0000000016042a67/0xdab2421a42e474d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474dd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456434:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583762.456437:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456441:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a6ab5c3 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:1.0:1784583762.456443:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456448:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583762.456452:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583762.456456:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583762.456498:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456505:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583762.456509:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456514:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 000000004a6ab5c3/0xdab2421a42e47466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4746d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.456524:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583762.456525:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583762.456527:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583762.456541:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bee68901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599018624:0@lo:103: 00000100:00100000:1.0:1784583762.456599:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.456641:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583762.456647:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc362ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599018496:0@lo:103: 00000100:00100000:1.0:1784583762.456665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.456693:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018624 00000100:00100000:1.0:1784583762.456699:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018624 00010000:00010000:1.0:1784583762.456724:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 13 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.456966:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018496 00000100:00100000:1.0:1784583762.456970:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018496 00010000:00010000:1.0:1784583762.456985:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 14 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.457001:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583762.457106:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000886eb4d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3642:x1871271599018624:12345-0@lo:103: 00010000:00010000:1.0:1784583762.457128:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583762.457133:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457143:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457156:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d76d83af/0xdab2421a42e4746d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47466 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457169:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583762.457203:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000886eb4d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:3642:x1871271599018624:12345-0@lo:103: Request processed in 101us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.457209:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583762.457225:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.457231:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b2908ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:3642:x1871271599018496:12345-0@lo:103: 00010000:00010000:1.0:1784583762.457238:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583762.457243:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457249:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457257:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d34f5042/0xdab2421a42e474dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e474d6 expref: 12 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.457402:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583762.457447:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b2908ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:3642:x1871271599018496:12345-0@lo:103: Request processed in 216us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.457453:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.457724:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc362ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599018496:0@lo:103: 00000100:00100000:1.0:1784583762.458375:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bee68901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599018624:0@lo:103: 00010000:00010000:2.0:1784583762.458462:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583762.458549:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018368 00000100:00100000:2.0:1784583762.458555:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018368 00000100:00100000:2.0:1784583762.458584:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583762.458599:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000829a146b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599018368:12345-0@lo:104: 00010000:00010000:2.0:1784583762.458610:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.458708:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583762.458713:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000829a146b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599018368:12345-0@lo:104: Request processed in 115us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.458719:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784583762.458809:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583762.458814:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.458822:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf2a0148 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:1.0:1784583762.458824:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.458830:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583762.458835:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583762.458840:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583762.458868:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.458873:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583762.458885:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.458890:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e4744a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47451 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.458903:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583762.458969:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583762.458972:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583762.459075:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bee68901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599018752:0@lo:103: 00000100:00100000:2.0:1784583762.459111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.459393:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018752 00000100:00100000:1.0:1784583762.459398:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018752 00010000:00010000:1.0:1784583762.459417:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.459445:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784583762.459450:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d123e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:3639:x1871271599018752:12345-0@lo:103: 00010000:00010000:1.0:1784583762.459459:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583762.459462:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459492:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459508:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459515:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459527:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459533:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459538:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459544:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459560:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b66f7864 already unused, calling callback (000000004f9daade) 00010000:00010000:1.0:1784583762.459563:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459569:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459576:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.459584:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583762.459624:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d123e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:3639:x1871271599018752:12345-0@lo:103: Request processed in 173us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.459630:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583762.459738:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bee68901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599018752:0@lo:103: 00010000:00010000:0.0:1784583762.459987:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003610a6f6/0xdab2421a42e47451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4744a expref: 10 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.460000:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599018368:0@lo:104: 00010000:00010000:0.0:1784583762.460017:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.460024:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.460029:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.460042:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b66f7864/0xdab2421a42e4751c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784583762.460058:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784583762.463019:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d117599f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:7443:x1871271599017984:12345-0@lo:253: Request processed in 52177us (52632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.463035:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784583762.463115:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010c3c326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599017984:0@lo:253: 10000000:01000000:2.0:1784583762.463130:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784583762.463134:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784583762.463135:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784583762.463137:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583762.463138:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1784583762.463139:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583762.463141:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583762.463142:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784583762.463143:0:7443:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784583762.463145:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583762.463146:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784583762.463164:0:7443:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b989d2d9 from lustre-MDT0001 10000000:01000000:2.0:1784583762.463195:0:7443:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784583762.463197:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784583762.463203:0:7443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b4331acd40 local copy 10000000:01000000:2.0:1784583762.463207:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784583762.463238:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.463339:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.463348:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.463367:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599018880:0@lo:101: 00000100:00100000:2.0:1784583762.463413:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.463511:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000000809fb41 going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.463649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599018880 00000100:00100000:1.0:1784583762.463655:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599018880 00000100:00100000:1.0:1784583762.463723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784583762.463738:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab359edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:7443:x1871271599018880:12345-0@lo:101: 00010000:00010000:1.0:1784583762.463757:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583762.463770:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b367b980/0xdab2421a42e4752a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47523 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.463791:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b367b980/0xdab2421a42e4752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47523 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.463801:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b367b980/0xdab2421a42e4752a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47523 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.463809:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b367b980, rc 0) 00000100:00100000:1.0:1784583762.463859:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab359edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:7443:x1871271599018880:12345-0@lo:101: Request processed in 130us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.463865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784583762.463930:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599018880:0@lo:101: 00010000:00010000:2.0:1784583762.463941:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.463949:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.464033:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019008:0@lo:501: 00000100:00100000:2.0:1784583762.464058:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.464406:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000000809fb41 going to sleep for 11 seconds 00000100:00100000:0.0:1784583762.464536:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019008 00000100:00100000:0.0:1784583762.464541:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019008 00000100:00100000:0.0:1784583762.464567:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784583762.464573:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fede368e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:7443:x1871271599019008:12345-0@lo:501: 00000100:00100000:0.0:1784583762.464651:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fede368e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:7443:x1871271599019008:12345-0@lo:501: Request processed in 78us (592us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784583762.464659:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784583762.464830:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019008:0@lo:501: 10000000:01000000:2.0:1784583762.464846:0:7443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784583762.464865:0:7443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784583762.464869:0:7443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.464877:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.464891:0:7443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.464971:0:7443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784583762.464999:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b42ba2f000 10000000:01000000:2.0:1784583762.465003:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784583762.465007:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98b4331acd40 10000000:01000000:2.0:1784583762.465010:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784583762.465012:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98b4331acd40 from 1 10000000:01000000:2.0:1784583762.465015:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784583762.465033:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.465040:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.465047:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.465060:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019136:0@lo:101: 00000100:00100000:2.0:1784583762.465086:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.465104:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00010000:00010000:0.0:1784583762.465155:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583762.465160:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465167:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000560e9063 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:0.0:1784583762.465169:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465176:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583762.465181:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583762.465197:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583762.465214:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465219:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583762.465241:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465247:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e47523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e4752a expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465336:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.465339:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.465340:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583762.465348:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583762.465358:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599019264:0@lo:103: 00000100:00100000:0.0:1784583762.465395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.465429:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019264 00000100:00100000:0.0:1784583762.465433:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019264 00000100:00100000:0.0:1784583762.465463:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784583762.465494:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffca584b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:3639:x1871271599019264:12345-0@lo:103: 00010000:00010000:0.0:1784583762.465504:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583762.465515:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b367b980/0xdab2421a42e4752a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47523 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465527:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583762.465555:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffca584b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:3639:x1871271599019264:12345-0@lo:103: Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.465571:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784583762.465592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019136 00000100:00100000:0.0:1784583762.465595:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019136 00000100:00100000:0.0:1784583762.465610:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784583762.465615:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016c51fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:7443:x1871271599019136:12345-0@lo:101: 00010000:00010000:0.0:1784583762.465622:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583762.465631:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eec1dc19/0xdab2421a42e47538 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47531 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465646:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eec1dc19/0xdab2421a42e47538 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47531 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465653:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eec1dc19/0xdab2421a42e47538 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47531 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.465659:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eec1dc19, rc 0) 00000100:00100000:0.0:1784583762.465684:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016c51fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:7443:x1871271599019136:12345-0@lo:101: Request processed in 69us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.465689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784583762.465719:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599019264:0@lo:103: 00000100:00100000:2.0:1784583762.465886:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019136:0@lo:101: 00010000:00010000:2.0:1784583762.465896:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.465904:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.466036:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784583762.466044:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466050:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000009f4172dd/0xdab2421a42e47531 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.466059:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b42ba2f000 10000000:01000000:2.0:1784583762.466074:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784583762.466078:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b42ba2f000 from 1 10000000:01000000:2.0:1784583762.466081:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784583762.466097:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466103:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466110:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.466121:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019392:0@lo:101: 00000100:00100000:2.0:1784583762.466147:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.466167:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:0.0:1784583762.466214:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019392 00000100:00100000:0.0:1784583762.466218:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019392 00000100:00100000:0.0:1784583762.466236:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784583762.466241:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031d93d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:7443:x1871271599019392:12345-0@lo:101: 00010000:00010000:0.0:1784583762.466248:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583762.466254:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5942fd7/0xdab2421a42e47546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4753f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.466287:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5942fd7/0xdab2421a42e47546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4753f expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.466294:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5942fd7/0xdab2421a42e47546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4753f expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.466300:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5942fd7, rc 0) 00000100:00100000:0.0:1784583762.466331:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031d93d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:7443:x1871271599019392:12345-0@lo:101: Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.466336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784583762.466486:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019392:0@lo:101: 00010000:00010000:2.0:1784583762.466496:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466502:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.466519:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784583762.466528:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466533:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000f42882a0/0xdab2421a42e4753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.466538:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784583762.466540:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784583762.466545:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b42ba2f000 10000000:01000000:2.0:1784583762.466547:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784583762.466550:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784583762.466552:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784583762.466564:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466570:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.466575:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.466584:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019520:0@lo:101: 00000100:00100000:2.0:1784583762.466605:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.466614:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.467022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019520 00000100:00100000:1.0:1784583762.467028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019520 00000100:00100000:1.0:1784583762.467056:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784583762.467062:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c83cf04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:7443:x1871271599019520:12345-0@lo:101: 00010000:00010000:1.0:1784583762.467071:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583762.467080:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cabb152/0xdab2421a42e47554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4754d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.467094:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cabb152/0xdab2421a42e47554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4754d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.467101:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cabb152/0xdab2421a42e47554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4754d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.467107:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cabb152, rc 0) 00000100:00100000:1.0:1784583762.467145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c83cf04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019520:12345-0@lo:101: Request processed in 82us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.467151:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784583762.467241:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019520:0@lo:101: 00010000:00010000:2.0:1784583762.467250:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.467280:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.467363:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019648:0@lo:501: 00000100:00100000:2.0:1784583762.467398:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.467423:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.467560:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019648 00000100:00100000:1.0:1784583762.467565:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019648 00000100:00100000:1.0:1784583762.467583:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784583762.467588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080ee9fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019648:12345-0@lo:501: 00000100:00100000:1.0:1784583762.467673:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080ee9fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019648:12345-0@lo:501: Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.467679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784583762.468207:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019648:0@lo:501: 00000100:00100000:2.0:1784583762.468236:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019776:0@lo:503: 00000100:00100000:2.0:1784583762.468285:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.468339:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.468696:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019776 00000100:00100000:1.0:1784583762.468707:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019776 00000100:00100000:2.0:1784583762.468981:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784583762.468989:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061935984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019776:12345-0@lo:503: 00000100:00100000:2.0:1784583762.469093:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061935984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019776:12345-0@lo:503: Request processed in 106us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.469099:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784583762.469146:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019776:0@lo:503: 00000040:00080000:2.0:1784583762.469400:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784583762.469460:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019904:0@lo:502: 00000100:00100000:2.0:1784583762.469516:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.469538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599019904 00000100:00100000:2.0:1784583762.469542:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599019904 00000100:00100000:2.0:1784583762.469559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784583762.469564:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cbbddb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019904:12345-0@lo:502: 00000100:00100000:2.0:1784583762.469634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cbbddb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599019904:12345-0@lo:502: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.469646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784583762.469679:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:2.0:1784583762.469689:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599019904:0@lo:502: 00000040:00080000:2.0:1784583762.470420:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784583762.470454:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1784583762.470618:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1784583762.470638:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1784583762.470650:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1784583762.470662:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1784583762.470674:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1784583762.470686:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1784583762.470700:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1784583762.470711:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1784583762.470723:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1784583762.470975:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1784583762.470993:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1784583762.471006:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1784583762.471018:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1784583762.471031:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1784583762.471041:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1784583762.471052:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1784583762.471065:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1784583762.471076:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1784583762.471086:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1784583762.471097:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1784583762.471108:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1784583762.471136:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020032:0@lo:502: 00000100:00100000:2.0:1784583762.471188:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.471290:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e9e6605 going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.471395:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020032 00000100:00100000:3.0:1784583762.471401:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020032 00000100:00100000:1.0:1784583762.481335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784583762.481359:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cbcd0fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599020032:12345-0@lo:502: 00000100:00100000:1.0:1784583762.481564:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cbcd0fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599020032:12345-0@lo:502: Request processed in 215us (10376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.481573:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784583762.482893:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d3014c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020032:0@lo:502: 00000040:00080000:3.0:1784583762.483022:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1784583762.483036:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1784583762.486318:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583762.486332:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583762.486335:0:7455:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784583762.486340:0:7455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1784583762.486357:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784583762.486373:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000012c32628) 00000020:00000080:3.0:1784583762.486407:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1784583762.486413:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784583762.486510:0:7455:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784583762.486518:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47562 00000020:00000080:3.0:1784583762.487136:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1784583762.487143:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583762.487148:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583762.487149:0:7455:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784583762.487153:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583762.487156:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583762.487157:0:7455:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1784583762.487160:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784583762.487169:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000001a987141) 00000020:00000080:3.0:1784583762.487183:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1784583762.487188:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784583762.487190:0:7455:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1784583762.487192:0:7455:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1784583762.487200:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784583762.487538:0:7455:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b989d2d9 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1784583762.487560:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000034341bd5) 00000020:00000080:3.0:1784583762.487571:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1784583762.487623:0:7455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784583762.487629:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e47577 00000020:00000080:3.0:1784583762.488171:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1784583762.489578:0:7455:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784583762.489607:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdab2421a42e4757e 00080000:01000000:2.0:1784583762.489621:0:7455:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784583762.489625:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47585 00080000:10000000:2.0:1784583762.490443:0:7455:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1784583762.490676:0:7455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1784583762.621249:0:7455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1784583762.621611:0:7455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1784583762.628545:0:7455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784583762.629220:0:7455:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784583762.639558:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1784583762.639569:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583762.639575:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583762.639577:0:7455:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1784583762.639581:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583762.639586:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583762.639588:0:7455:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784583762.639598:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784583762.639603:0:7455:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:3.0:1784583762.639627:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784583762.639640:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000026c2063f) 00000020:00000080:3.0:1784583762.639660:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1784583762.639665:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784583762.639744:0:7455:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784583762.639750:0:7455:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784583762.639756:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47593 00010000:00080000:3.0:1784583762.639783:0:7455:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003c32a0c6@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784583762.647652:0:7455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1784583762.654963:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784583762.654978:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784583762.655015:0:7455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784583762.655036:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4759a 00000100:00080000:2.0:1784583762.655046:0:7455:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784583762.655051:0:7455:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000003c32a0c6 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583762.655085:0:7455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004ea3678d x1871271599020160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784583762.655111:0:7455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1784583762.655173:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583762.655177:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655179:0:7455:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1784583762.655182:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784583762.655184:0:7455:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1784583762.655185:0:7455:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784583762.655187:0:7455:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784583762.655188:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784583762.655190:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655191:0:7455:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784583762.655194:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583762.655198:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655201:0:7455:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1784583762.655212:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784583762.655242:0:7455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784583762.655255:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583762.655258:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655259:0:7455:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1784583762.655261:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583762.655264:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655265:0:7455:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784583762.655267:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784583762.655269:0:7455:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784583762.655294:0:7455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583762.655297:0:7455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583762.655298:0:7455:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784583762.655301:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1784583762.655351:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1784583762.655377:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784583762.655398:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.655410:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000006104beac/0xdab2421a42e4754d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.655417:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b42ba2f000 from 1 10000000:01000000:2.0:1784583762.655420:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583762.655441:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.655448:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.655456:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.655511:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000786bf316 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020288:0@lo:101: 00000100:00100000:2.0:1784583762.655569:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.655607:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000007430c5ac going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.655906:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ea3678d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599020160:0@lo:38: 00000100:00100000:3.0:1784583762.655943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.656203:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020288 00000100:00100000:0.0:1784583762.656209:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020288 00000100:00100000:0.0:1784583762.656244:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784583762.656251:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a4dbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+12:7443:x1871271599020288:12345-0@lo:101: 00010000:00010000:0.0:1784583762.656263:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583762.656275:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e475a1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.656297:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.656306:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.656314:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b66f7864, rc 0) 00000100:00100000:0.0:1784583762.656349:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a4dbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:7443:x1871271599020288:12345-0@lo:101: Request processed in 98us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.656355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784583762.656436:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000786bf316 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020288:0@lo:101: 00010000:00010000:0.0:1784583762.656450:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.656458:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583762.657058:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583762.657069:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599020416:0@lo:400: 00000100:00100000:3.0:1784583762.657109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.657516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020416 00000100:00100000:1.0:1784583762.657524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020416 00000100:00100000:1.0:1784583762.657571:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.657578:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab087dce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599020416:12345-0@lo:400: 00000100:00100000:1.0:1784583762.657639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab087dce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599020416:12345-0@lo:400: Request processed in 62us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.657646:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784583762.657678:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000920764ba x1871271599020416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583762.657688:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000920764ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599020416:0@lo:400: 00000100:00100000:0.0:1784583762.658162:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f66cd169 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020544:0@lo:256: 00000100:00100000:0.0:1784583762.658199:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.658270:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:2.0:1784583762.658352:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020160 00000100:00100000:2.0:1784583762.658357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020160 00000100:00100000:2.0:1784583762.658391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784583762.658395:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c643042 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599020160:12345-0@lo:38: 00010000:00080000:2.0:1784583762.658417:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1784583762.658450:0:6519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e475af 00000004:00100000:2.0:1784583762.658464:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784583762.658488:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1784583762.659864:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020544 00000100:00100000:3.0:1784583762.659875:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020544 00000100:00100000:3.0:1784583762.659928:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583762.659935:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041dc39f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:7443:x1871271599020544:12345-0@lo:256: 20000000:01000000:3.0:1784583762.659954:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784583762.659973:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784583762.659976:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784583762.660080:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041dc39f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:7443:x1871271599020544:12345-0@lo:256: Request processed in 146us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.660088:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784583762.660188:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f66cd169 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020544:0@lo:256: 10000000:01000000:2.0:1784583762.660829:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784583762.660845:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.660855:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583762.660863:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b42ba2f000 from 1 10000000:01000000:2.0:1784583762.660865:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784583762.660893:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.660901:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.661535:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.661556:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020672:0@lo:101: 00000100:00100000:2.0:1784583762.661603:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.661639:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000007430c5ac going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.661803:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020672 00000100:00100000:1.0:1784583762.661810:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020672 00000100:00100000:1.0:1784583762.661843:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583762.661850:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037161765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:7443:x1871271599020672:12345-0@lo:101: 00010000:00010000:1.0:1784583762.661860:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583762.661872:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e475b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.661893:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.661904:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.661931:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a6ab5c3, rc 0) 00000100:00100000:1.0:1784583762.661968:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037161765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599020672:12345-0@lo:101: Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.661975:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784583762.665882:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020672:0@lo:101: 00010000:00010000:2.0:1784583762.665913:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583762.665925:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583762.666039:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020800:0@lo:501: 00000100:00100000:2.0:1784583762.666091:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.666134:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000007430c5ac going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.666226:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020800 00000100:00100000:1.0:1784583762.666232:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020800 00000100:00100000:1.0:1784583762.666273:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583762.666280:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000111b2e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599020800:12345-0@lo:501: 00000100:00100000:1.0:1784583762.666372:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000111b2e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599020800:12345-0@lo:501: Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.666390:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784583762.666461:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020800:0@lo:501: 00000100:00100000:2.0:1784583762.666575:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020928:0@lo:503: 00000100:00100000:2.0:1784583762.666621:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.666670:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 000000007430c5ac going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.669320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599020928 00000100:00100000:1.0:1784583762.669335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599020928 00000100:00100000:1.0:1784583762.669392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784583762.669400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007efd9d98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599020928:12345-0@lo:503: 00000040:00080000:1.0:1784583762.669451:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784583762.669542:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007efd9d98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599020928:12345-0@lo:503: Request processed in 144us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.669551:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784583762.669742:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1904d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599020928:0@lo:503: 00000040:00080000:2.0:1784583762.670023:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583762.670072:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1784583762.670147:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1784583762.671439:0:6519:0:(import.c:65:import_set_state_nolock()) 00000000cbae2b68 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583762.671589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c643042 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599020160:12345-0@lo:38: Request processed in 13191us (15644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.671602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583762.671688:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784583762.671697:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1784583762.671705:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784583762.671731:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784583762.671734:0:3638:0:(import.c:65:import_set_state_nolock()) 000000003c32a0c6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583762.671749:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ea3678d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599020160:0@lo:38: 00000100:00100000:3.0:1784583762.672175:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc362ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599021056:0@lo:41: 00000100:00100000:3.0:1784583762.672212:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.672303:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021056 00000100:00100000:1.0:1784583762.672309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021056 00000100:00100000:1.0:1784583762.672349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583762.672356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecb39f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599021056:12345-0@lo:41: 00000004:00000024:1.0:1784583762.672395:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1784583762.672434:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecb39f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599021056:12345-0@lo:41: Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.672440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583762.672494:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc362ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599021056:0@lo:41: 00000040:00080000:2.0:1784583762.673596:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1784583762.673867:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784583762.673963:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784583762.673985:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.673998:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583762.674052:0:7443:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784583762.674054:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b42ba2f000 10000000:01000000:0.0:1784583762.674058:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b42ba2f000 10000000:01000000:0.0:1784583762.674061:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784583762.674067:0:7443:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b42ba2f000 from 1 10000000:01000000:0.0:1784583762.674070:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784583762.674099:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.674107:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.674132:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.674150:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021184:0@lo:101: 00000100:00100000:0.0:1784583762.674198:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.674315:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.676988:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021184 00000100:00100000:1.0:1784583762.677003:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021184 00000100:00100000:1.0:1784583762.677063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784583762.677072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd09a643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:7443:x1871271599021184:12345-0@lo:101: 00010000:00010000:1.0:1784583762.677090:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583762.677108:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000944f1a54/0xdab2421a42e475cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e475c4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.677135:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000944f1a54/0xdab2421a42e475cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.677145:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000944f1a54/0xdab2421a42e475cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.677153:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000944f1a54, rc 0) 00000100:00100000:1.0:1784583762.677222:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd09a643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021184:12345-0@lo:101: Request processed in 152us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.677229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784583762.677335:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021184:0@lo:101: 00010000:00010000:0.0:1784583762.677352:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.677361:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583762.677520:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021312:0@lo:501: 00000100:00100000:0.0:1784583762.677553:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.677579:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.677633:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021312 00000100:00100000:3.0:1784583762.677639:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021312 00000100:00100000:3.0:1784583762.677661:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784583762.677667:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042da97f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021312:12345-0@lo:501: 00000100:00100000:3.0:1784583762.677781:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042da97f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021312:12345-0@lo:501: Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.677789:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784583762.677900:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021312:0@lo:501: 00000100:00100000:0.0:1784583762.677926:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021440:0@lo:503: 00000100:00100000:0.0:1784583762.677962:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.677982:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:2.0:1784583762.678038:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021440 00000100:00100000:2.0:1784583762.678048:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021440 00000100:00100000:2.0:1784583762.678067:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583762.678073:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0279044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021440:12345-0@lo:503: 00000100:00100000:2.0:1784583762.678148:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0279044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021440:12345-0@lo:503: Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.678156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784583762.678216:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021440:0@lo:503: 00000040:00080000:0.0:1784583762.678529:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784583762.678598:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021568:0@lo:502: 00000100:00100000:0.0:1784583762.678631:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.678650:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:2.0:1784583762.679016:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021568 00000100:00100000:2.0:1784583762.679021:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021568 00000100:00100000:2.0:1784583762.679045:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583762.679050:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1908c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021568:12345-0@lo:502: 00000100:00100000:2.0:1784583762.679143:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1908c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021568:12345-0@lo:502: Request processed in 93us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583762.679150:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784583762.679388:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021568:0@lo:502: 00000040:00080000:0.0:1784583762.679610:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784583762.679639:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784583762.679654:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784583762.679667:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784583762.679681:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784583762.679694:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784583762.679707:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784583762.679741:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784583762.679756:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784583762.679769:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784583762.679781:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784583762.679794:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784583762.679806:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784583762.679819:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784583762.679833:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784583762.679846:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784583762.679859:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784583762.679872:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784583762.679896:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784583762.679910:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784583762.679925:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784583762.680261:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784583762.680282:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784583762.680295:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784583762.680310:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784583762.680323:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784583762.680337:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784583762.680350:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1784583762.680389:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021696:0@lo:502: 00000100:00100000:0.0:1784583762.680442:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.680561:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a723602c going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.681127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021696 00000100:00100000:3.0:1784583762.681135:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021696 00000100:00100000:3.0:1784583762.681183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784583762.681190:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f83e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021696:12345-0@lo:502: 00000100:00100000:3.0:1784583762.681300:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f83e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021696:12345-0@lo:502: Request processed in 111us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.681307:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784583762.681453:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021696:0@lo:502: 00000040:00080000:0.0:1784583762.681532:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784583762.681543:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784583762.682295:0:7462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1784583762.682309:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d5a31843) 00000020:00000080:3.0:1784583762.682328:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1784583762.682529:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b989d2d9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784583762.682534:0:7462:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b989d2d9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784583762.682536:0:7462:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b989d2d9 3 00010000:00080000:3.0:1784583762.682562:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009a726abd@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784583762.686409:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1784583762.686821:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1784583762.686865:0:7462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784583762.686877:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdab2421a42e475d9 00000100:00080000:3.0:1784583762.687043:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784583762.687049:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009a726abd using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784583762.687084:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a84d05a3 x1871271599021824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784583762.687110:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784583762.687195:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a84d05a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599021824:0@lo:38: 00000100:00100000:1.0:1784583762.687261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.687315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021824 00000100:00100000:1.0:1784583762.687321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021824 00000100:00100000:1.0:1784583762.687350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.687365:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc362ddb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599021824:12345-0@lo:38: 00010000:00080000:1.0:1784583762.687397:0:6514:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1784583762.687427:0:6514:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdab2421a42e475e0 00000004:00100000:1.0:1784583762.687440:0:6514:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784583762.687481:0:6514:0:(import.c:65:import_set_state_nolock()) 000000003531570e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583762.687528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc362ddb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1871271599021824:12345-0@lo:38: Request processed in 163us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.687535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784583762.687568:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a84d05a3 x1871271599021824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583762.687577:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784583762.687584:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1784583762.687589:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784583762.687592:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784583762.687594:0:3638:0:(import.c:65:import_set_state_nolock()) 000000009a726abd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784583762.687599:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a84d05a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599021824:0@lo:38: 00000040:00080000:1.0:1784583762.690589:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1784583762.690700:0:7463:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1784583762.698643:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784583762.698687:0:7443:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784583762.698718:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.698739:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000e770f0ee/0xdab2421a42e475c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784583762.698795:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784583762.698798:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784583762.698799:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583762.698800:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784583762.698801:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583762.698803:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583762.698804:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784583762.698806:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784583762.698807:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784583762.698808:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583762.698810:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784583762.698813:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1784583762.698816:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784583762.698817:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784583762.698818:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583762.698819:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784583762.698820:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583762.698821:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583762.698822:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784583762.698823:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784583762.698824:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784583762.698825:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583762.698825:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784583762.698853:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784583762.698875:0:7443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021952:0@lo:253: 00000100:00100000:0.0:1784583762.699214:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583762.699253:0:7443:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5e54c24 going to sleep for 11 seconds 00000100:00100000:0.0:1784583762.699276:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599021952 00000100:00100000:0.0:1784583762.699282:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599021952 00000100:00100000:0.0:1784583762.699326:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784583762.699332:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088aa19e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021952:12345-0@lo:253: 20000000:01000000:0.0:1784583762.699357:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784583762.699369:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1784583762.704414:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1784583762.704506:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784583762.704517:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784583762.704635:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784583762.704640:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784583762.704658:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704676:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704683:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704701:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704746:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704758:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 15 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.704770:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb6da8ad pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599022080:0@lo:104: 00000100:00100000:1.0:1784583762.704820:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583762.704856:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.704863:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 15 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.704870:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e22c128 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599022208:0@lo:104: 00000100:00100000:1.0:1784583762.704895:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.704911:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set 0000000023b6e7b2 going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.705145:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022080 00000100:00100000:3.0:1784583762.705151:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022080 00000100:00100000:3.0:1784583762.705178:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022208 00000100:00100000:3.0:1784583762.705180:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022208 00000100:00100000:3.0:1784583762.705190:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784583762.705196:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f548005 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599022080:12345-0@lo:104: 00010000:00010000:3.0:1784583762.705206:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583762.705258:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583762.705263:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f548005 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599022080:12345-0@lo:104: Request processed in 67us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.705269:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784583762.705282:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784583762.705286:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000542f9e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599022208:12345-0@lo:104: 00010000:00010000:3.0:1784583762.705292:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583762.705314:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784583762.705324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000542f9e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599022208:12345-0@lo:104: Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.705329:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583762.705392:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb6da8ad pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599022080:0@lo:104: 00000100:00100000:1.0:1784583762.705400:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e22c128 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599022208:0@lo:104: 00010000:00010000:1.0:1784583762.705416:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.705627:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784583762.705632:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.705639:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e09c1b52 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:0.0:1784583762.705642:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.705649:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583762.705655:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583762.705661:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583762.705689:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.705694:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784583762.705853:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088aa19e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7443:x1871271599021952:12345-0@lo:253: Request processed in 6520us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583762.705860:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1784583762.705991:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.705998:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475a8 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706008:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583762.706010:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706016:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c94904fb already unused, calling callback (00000000cdafcdd2) 10000000:00010000:0.0:1784583762.706018:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706024:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583762.706030:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583762.706034:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583762.706053:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706058:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583762.706062:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706067:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000c94904fb/0xdab2421a42e474f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47500 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583762.706078:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.706084:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.706085:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583762.706091:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583762.706145:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003046eed7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599022336:0@lo:103: 00000100:00100000:2.0:1784583762.706173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.706205:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583762.706209:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a92036e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599022464:0@lo:103: 00000100:00100000:2.0:1784583762.706229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.706263:0:7443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006afdb9e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:7443:1871271599021952:0@lo:253: 10000000:01000000:2.0:1784583762.706271:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784583762.706274:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784583762.706276:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784583762.706277:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583762.706279:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583762.706280:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583762.706281:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583762.706283:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784583762.706284:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583762.706289:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583762.706291:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583762.706292:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784583762.706301:0:7443:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784583762.706853:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022336 00000100:00100000:1.0:1784583762.706859:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022336 00010000:00010000:1.0:1784583762.706879:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 15 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.706915:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022464 00000100:00100000:1.0:1784583762.706918:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022464 00010000:00010000:1.0:1784583762.706928:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 16 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583762.706948:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784583762.706954:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1904d4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3639:x1871271599022336:12345-0@lo:103: 00010000:00010000:1.0:1784583762.706964:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583762.706968:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 16 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.706976:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 16 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.706990:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b66f7864/0xdab2421a42e475a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e475a1 expref: 16 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707003:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583762.707036:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1904d4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3639:x1871271599022336:12345-0@lo:103: Request processed in 83us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.707043:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784583762.707067:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583762.707072:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083b0667a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3639:x1871271599022464:12345-0@lo:103: 00010000:00010000:1.0:1784583762.707078:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583762.707081:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707088:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707101:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a495f360/0xdab2421a42e47500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e474f9 expref: 14 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707111:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707118:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784583762.707130:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002601373s 00010000:00010000:1.0:1784583762.707134:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707139:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707145:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707151:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707155:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000027a56f9b already unused, calling callback (000000004f9daade) 00010000:00010000:1.0:1784583762.707158:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707164:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707174:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707191:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583762.707208:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083b0667a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:3639:x1871271599022464:12345-0@lo:103: Request processed in 138us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.707214:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583762.707254:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a92036e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599022464:0@lo:103: 00000100:00100000:1.0:1784583762.707261:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003046eed7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599022336:0@lo:103: 00010000:00010000:1.0:1784583762.707276:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707282:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583762.707288:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000027a56f9b/0xdab2421a42e475e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1784583762.715722:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1784583762.715904:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1784583762.716116:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1784583762.716286:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1784583762.716522:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1784583762.716670:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1784583762.720397:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784583762.720697:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1784583762.721094:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1784583762.721267:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1784583762.721448:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1784583762.721640:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1784583762.724519:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1784583762.724584:0:7467:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1784583762.724589:0:7467:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784583762.724912:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784583762.725144:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1784583762.725246:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1871271599022592:0@lo:700: 00000100:00100000:2.0:1784583762.725311:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.725344:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 00000000850cdcca going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.725418:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022592 00000100:00100000:3.0:1784583762.725425:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022592 00000100:00100000:3.0:1784583762.725494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583762.725502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b026ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1871271599022592:12345-0@lo:700: 00000100:00100000:2.0:1784583762.726128:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000078271361 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599022720:0@lo:1000: 00000100:00100000:2.0:1784583762.726168:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583762.726202:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1df5743 going to sleep for 11 seconds 00000040:01000000:0.0:1784583762.726607:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1784583762.727210:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784583762.727678:0:7443:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784583762.727686:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1784583762.728365:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784583762.728586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022720 00000100:00100000:1.0:1784583762.728596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022720 00000100:00100000:1.0:1784583762.728643:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.728651:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095cdaa70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599022720:12345-0@lo:1000: 00000100:00100000:1.0:1784583762.728777:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095cdaa70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599022720:12345-0@lo:1000: Request processed in 127us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.728785:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583762.728829:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000078271361 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599022720:0@lo:1000: 00000040:01000000:1.0:1784583762.728866:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1784583762.728910:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599022848:0@lo:700: 00000100:00100000:1.0:1784583762.728953:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.728993:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022848 00000100:00100000:1.0:1784583762.728997:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022848 00000100:00100000:1.0:1784583762.729037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583762.729043:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b2908ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599022848:12345-0@lo:700: 00000100:00100000:1.0:1784583762.729080:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b2908ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599022848:12345-0@lo:700: Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.729086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583762.729111:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039e89c2e going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.729122:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599022848:0@lo:700: 00000100:00100000:1.0:1784583762.729160:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1871271599022976:0@lo:900: 00000100:00100000:1.0:1784583762.729183:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.729211:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599022976 00000100:00100000:1.0:1784583762.729214:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599022976 00000100:00100000:1.0:1784583762.729236:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583762.729241:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e22c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1871271599022976:12345-0@lo:900: 00000100:00100000:1.0:1784583762.729270:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e22c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1871271599022976:12345-0@lo:900: Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.729276:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583762.729292:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039e89c2e going to sleep for 11 seconds 00010000:00080000:1.0:1784583762.729304:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000886eb4d9 x1871271599022976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784583778 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583762.729314:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1871271599022976:0@lo:900: 00000100:00100000:1.0:1784583762.729378:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023104:0@lo:1000: 00000100:00100000:1.0:1784583762.729416:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.729435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599023104 00000100:00100000:1.0:1784583762.729439:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599023104 00000100:00100000:1.0:1784583762.729461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784583762.729485:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb6da8ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023104:12345-0@lo:1000: 00000100:00100000:1.0:1784583762.729539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb6da8ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023104:12345-0@lo:1000: Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.729546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784583762.729560:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1df5743 going to sleep for 11 seconds 00000100:00100000:1.0:1784583762.729570:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023104:0@lo:1000: 00000004:00080000:1.0:1784583762.729603:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000039e89c2e with version 0 00000020:00100000:1.0:1784583762.729615:0:7469:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784583762.729620:0:7469:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000886eb4d9 x1871271599023360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784583762.729632:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023360:0@lo:1000: 00000100:00100000:1.0:1784583762.729653:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583762.729669:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599023360 00000100:00100000:1.0:1784583762.729672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599023360 00000100:00100000:1.0:1784583762.729687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784583762.729692:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071ece934 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023360:12345-0@lo:1000: 00000100:00100000:1.0:1784583762.729945:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000041368e4 going to sleep for 11 seconds 00000040:00080000:0.0:1784583762.732216:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784583762.734624:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784583762.734697:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784583762.735105:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784583762.735321:0:7443:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784583762.742653:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1784583762.743191:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1784583762.743344:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1784583762.745162:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1784583762.745435:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000001:00080000:3.0:1784583762.751540:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1784583762.751742:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071ece934 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023360:12345-0@lo:1000: Request processed in 22046us (22085us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784583762.751762:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1784583762.751904:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1784583762.751909:0:7469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784583762.751924:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000886eb4d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023360:0@lo:1000: 00000100:00100000:3.0:1784583762.752022:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002926334f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023488:0@lo:1000: 00000100:00100000:3.0:1784583762.752058:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583762.752105:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d1d9c110 going to sleep for 11 seconds 00000100:00100000:0.0:1784583762.752277:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599023488 00000100:00100000:0.0:1784583762.752291:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599023488 00000100:00100000:0.0:1784583762.752338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784583762.752347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be7a8123 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023488:12345-0@lo:1000: 00000100:00100000:0.0:1784583762.752425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be7a8123 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1871271599023488:12345-0@lo:1000: Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583762.752432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784583762.752460:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002926334f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1871271599023488:0@lo:1000: 00000040:00080000:0.0:1784583762.752500:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1784583762.752531:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000784fc34c with version 1 00100000:10000000:1.0:1784583762.755848:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784583762.756021:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784583762.756161:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784583762.756376:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784583762.756551:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784583762.756676:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784583762.756806:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784583762.756970:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784583762.757113:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784583762.757246:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784583762.757400:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784583762.757721:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784583762.757854:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000004:00080000:3.0:1784583762.759256:0:7459:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005db1bbc4 version 1 rpc_version 1 00000020:00100000:3.0:1784583762.759300:0:7459:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784583762.759310:0:7459:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008cc056f8 x1871271599023744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583762.759333:0:7459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008cc056f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1871271599023744:0@lo:1000: 00000100:00100000:3.0:1784583762.759408:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583762.759459:0:7459:0:(client.c:2702:ptlrpc_set_wait()) set 000000006f105680 going to sleep for 11 seconds 00000100:00100000:3.0:1784583762.759506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599023744 00000100:00100000:3.0:1784583762.759512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599023744 00000100:00100000:3.0:1784583762.759550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784583762.759569:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b19ed394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7459:x1871271599023744:12345-0@lo:1000: 00000040:00080000:0.0:1784583762.764341:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784583762.764427:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1784583762.766463:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1784583762.768159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b19ed394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7459:x1871271599023744:12345-0@lo:1000: Request processed in 8585us (8746us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784583762.768175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 40000000:02000000:1.0:1784583762.768291:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:2.0:1784583762.769458:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1784583762.769480:0:7459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784583762.769498:0:7459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008cc056f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1871271599023744:0@lo:1000: 00100000:10000000:0.0:1784583762.770655:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784583762.770890:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784583762.771043:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784583762.771176:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784583762.771307:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1784583762.771499:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784583762.771644:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784583762.771777:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784583762.771910:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1784583762.772059:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1784583762.772232:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1784583762.772363:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1784583762.772543:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1784583762.772699:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1784583762.772897:0:7443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1784583762.782395:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b026ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1871271599022592:12345-0@lo:700: Request processed in 56879us (57069us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583762.782414:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784583762.783509:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000db063a50 x1871271599022592/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784583778 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583762.783526:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1871271599022592:0@lo:700: 40000000:02000000:0.0:1784583762.783539:0:7468:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1784583762.790463:0:7443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784583762.790524:0:7443:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb9d41dd3988 00100000:10000000:1.0:1784583762.790532:0:7443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1784583762.795256:0:7443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784583762.795300:0:7443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784583762.795316:0:7443:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784583762.795333:0:7443:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784583762.799304:0:7443:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583762.799540:0:7443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1784583762.849962:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583762.879334:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784583762.879445:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784583762.879450:0:7468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1784583763.118173:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583764.142723:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583765.176835:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583766.189584:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583767.213760:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784583767.697989:0:7713:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784583767.725798:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce36030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599024000:0@lo:400: 00000100:00100000:2.0:1784583767.725865:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583767.725917:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784583767.725923:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599023872:0@lo:400: 00000100:00100000:2.0:1784583767.725951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583767.725988:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a9666c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599024128:0@lo:400: 00000100:00100000:2.0:1784583767.726013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583767.726029:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583767.726033:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599024256:0@lo:400: 00000100:00100000:2.0:1784583767.726053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583767.726089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024000 00000100:00100000:2.0:1784583767.726096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024000 00000100:00100000:2.0:1784583767.726137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024256 00000100:00100000:2.0:1784583767.726140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024256 00000100:00100000:2.0:1784583767.726154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583767.726161:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078271361 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599024000:12345-0@lo:400: 00000100:00100000:2.0:1784583767.726208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078271361 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599024000:12345-0@lo:400: Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583767.726216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583767.726231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784583767.726237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1904d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599024256:12345-0@lo:400: 00000100:00100000:2.0:1784583767.726265:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1904d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599024256:12345-0@lo:400: Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583767.726271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784583767.726301:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000db063a50 x1871271599024256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583767.726314:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599024256:0@lo:400: 00010000:00080000:2.0:1784583767.726364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ce36030e x1871271599024000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583767.726372:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce36030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599024000:0@lo:400: 00000100:00100000:0.0:1784583767.726705:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024128 00000100:00100000:0.0:1784583767.726711:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024128 00000100:00100000:0.0:1784583767.726744:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784583767.726750:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d123e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599024128:12345-0@lo:400: 00000100:00100000:0.0:1784583767.726798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d123e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599024128:12345-0@lo:400: Request processed in 48us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583767.726804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784583767.726832:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a9666c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599024128:0@lo:400: 00000100:00100000:1.0:1784583767.727191:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599023872 00000100:00100000:1.0:1784583767.727197:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599023872 00000100:00100000:1.0:1784583767.727394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784583767.727402:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d987ff4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:3642:x1871271599023872:12345-0@lo:400: 00000100:00100000:1.0:1784583767.727450:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d987ff4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:3642:x1871271599023872:12345-0@lo:400: Request processed in 50us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583767.727456:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784583767.730738:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599023872:0@lo:400: 00000100:00100000:0.0:1784583767.733681:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583767.733797:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599024384:0@lo:41: 00000100:00100000:0.0:1784583767.733861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583767.736025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024384 00000100:00100000:2.0:1784583767.736039:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024384 00000100:00100000:2.0:1784583767.736124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784583767.736133:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0358f5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599024384:12345-0@lo:41: 00000004:00000024:2.0:1784583767.736170:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1784583767.736255:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0358f5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599024384:12345-0@lo:41: Request processed in 123us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583767.736263:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784583767.736623:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599024384:0@lo:41: 00010000:00010000:0.0:1784583768.237593:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583768.599979:0:7765:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583768.600171:0:7765:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784583769.263071:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583770.285648:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784583770.797774:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784583770.797783:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b42ba2f000 from 4 10000000:01000000:2.0:1784583770.797788:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583770.797841:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.797855:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.797865:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583770.797887:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024512:0@lo:101: 00000100:00100000:2.0:1784583770.797953:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583770.798023:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f772f19b going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.798168:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024512 00000100:00100000:3.0:1784583770.798175:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024512 00000100:00100000:3.0:1784583770.798229:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784583770.798238:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000271e1f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+13:6510:x1871271599024512:12345-0@lo:101: 00010000:00010000:3.0:1784583770.798250:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583770.798262:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d82b5209/0xdab2421a42e475f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e475ee expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583770.798284:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d82b5209/0xdab2421a42e475f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e475ee expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583770.798293:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d82b5209/0xdab2421a42e475f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475ee expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583770.798301:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d82b5209, rc 0) 00000100:00100000:3.0:1784583770.798355:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000271e1f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:6510:x1871271599024512:12345-0@lo:101: Request processed in 119us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.798362:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583770.798513:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024512:0@lo:101: 00010000:00010000:2.0:1784583770.798528:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.798536:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583770.798587:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024640:0@lo:256: 00000100:00100000:2.0:1784583770.798622:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583770.798646:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f772f19b going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.798736:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024640 00000100:00100000:0.0:1784583770.798741:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024640 00000100:00100000:0.0:1784583770.798773:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784583770.798781:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000626f4745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:6510:x1871271599024640:12345-0@lo:256: 20000000:01000000:0.0:1784583770.798795:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784583770.798815:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784583770.798818:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784583770.799035:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000626f4745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:6510:x1871271599024640:12345-0@lo:256: Request processed in 256us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.799043:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784583770.799111:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024640:0@lo:256: 10000000:01000000:2.0:1784583770.799159:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784583770.799165:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.799173:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000e09c1b52/0xdab2421a42e475ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583770.799182:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784583770.799184:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b418942800 from 21 10000000:01000000:2.0:1784583770.799186:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784583770.799204:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.799211:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.799217:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583770.799236:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024768:0@lo:101: 00000100:00100000:2.0:1784583770.799261:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583770.799318:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f772f19b going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.800665:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024768 00000100:00100000:0.0:1784583770.800688:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024768 00000100:00100000:0.0:1784583770.801648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784583770.801657:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeee45dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:6510:x1871271599024768:12345-0@lo:101: 00010000:00010000:0.0:1784583770.801686:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583770.801787:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aab9aa0b/0xdab2421a42e47603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e475fc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.801823:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aab9aa0b/0xdab2421a42e47603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e475fc expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.801833:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aab9aa0b/0xdab2421a42e47603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475fc expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.801841:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aab9aa0b, rc 0) 00000100:00100000:0.0:1784583770.801896:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeee45dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599024768:12345-0@lo:101: Request processed in 240us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.801902:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784583770.802123:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024768:0@lo:101: 00010000:00010000:2.0:1784583770.802140:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.802150:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583770.802233:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024896:0@lo:501: 00000100:00100000:2.0:1784583770.802267:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583770.802349:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f772f19b going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.802577:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599024896 00000100:00100000:0.0:1784583770.802583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599024896 00000100:00100000:0.0:1784583770.802645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784583770.802652:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dd522cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599024896:12345-0@lo:501: 00000100:00100000:0.0:1784583770.802778:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dd522cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599024896:12345-0@lo:501: Request processed in 126us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.802805:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784583770.802865:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599024896:0@lo:501: 00000100:00100000:2.0:1784583770.802891:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025024:0@lo:503: 00000100:00100000:2.0:1784583770.802930:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583770.803257:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f772f19b going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.803296:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025024 00000100:00100000:3.0:1784583770.803301:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025024 00000100:00100000:3.0:1784583770.803344:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784583770.803352:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abca543e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599025024:12345-0@lo:503: 00000100:00100000:3.0:1784583770.803452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abca543e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599025024:12345-0@lo:503: Request processed in 101us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.803460:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784583770.803485:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32639a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025024:0@lo:503: 00000100:00100000:3.0:1784583770.804085:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7835:1871271599025152:0@lo:502: 00000100:00100000:3.0:1784583770.804123:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.804154:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074e592de going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.804191:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025152 00000100:00100000:2.0:1784583770.804196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025152 00000100:00100000:2.0:1784583770.804227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784583770.804233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e610c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7835:x1871271599025152:12345-0@lo:502: 00000100:00100000:2.0:1784583770.804326:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e610c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7835:x1871271599025152:12345-0@lo:502: Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583770.804344:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784583770.804993:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7835:1871271599025152:0@lo:502: 00000100:00100000:3.0:1784583770.805038:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7835:1871271599025280:0@lo:502: 00000100:00100000:3.0:1784583770.805072:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.805093:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074e592de going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.805139:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025280 00000100:00100000:2.0:1784583770.805149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025280 00000100:00100000:2.0:1784583770.805179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784583770.805185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066e2b454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7835:x1871271599025280:12345-0@lo:502: 00000100:00100000:2.0:1784583770.805250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066e2b454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:7835:x1871271599025280:12345-0@lo:502: Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583770.805256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784583770.806829:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7835:1871271599025280:0@lo:502: 00000040:00080000:3.0:1784583770.806991:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784583770.807565:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784583770.807591:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784583770.807600:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.807611:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000bf2a0148/0xdab2421a42e475fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583770.807619:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784583770.807622:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b418942800 from 4 10000000:01000000:0.0:1784583770.807624:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784583770.807654:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.807660:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.807670:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583770.807686:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025408:0@lo:101: 00000100:00100000:0.0:1784583770.807738:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.807773:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5924f03 going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.807923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025408 00000100:00100000:2.0:1784583770.807929:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025408 00000100:00100000:2.0:1784583770.807964:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784583770.807972:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bab2641e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599025408:12345-0@lo:101: 00010000:00010000:2.0:1784583770.807983:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583770.807995:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016042a67/0xdab2421a42e47611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4760a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.808014:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016042a67/0xdab2421a42e47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4760a expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.808023:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016042a67/0xdab2421a42e47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4760a expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583770.808030:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016042a67, rc 0) 00000100:00100000:2.0:1784583770.808070:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bab2641e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599025408:12345-0@lo:101: Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583770.808077:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784583770.808144:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025408:0@lo:101: 00010000:00010000:0.0:1784583770.808155:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.808163:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583770.808211:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025536:0@lo:256: 00000100:00100000:0.0:1784583770.808238:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.808319:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5924f03 going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.811719:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025536 00000100:00100000:2.0:1784583770.811734:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025536 00000100:00100000:2.0:1784583770.811783:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784583770.811789:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006976606f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599025536:12345-0@lo:256: 20000000:01000000:2.0:1784583770.811823:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784583770.812266:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784583770.812269:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784583770.812404:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006976606f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599025536:12345-0@lo:256: Request processed in 614us (4164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583770.812412:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784583770.815033:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025536:0@lo:256: 10000000:01000000:0.0:1784583770.815093:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784583770.815102:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.815112:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000b66f7864/0xdab2421a42e4760a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583770.815120:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784583770.815122:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784583770.815125:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784583770.815152:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.815159:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.815166:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583770.815183:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025664:0@lo:101: 00000100:00100000:0.0:1784583770.815232:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.815267:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5924f03 going to sleep for 11 seconds 00000100:00100000:1.0:1784583770.816002:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025664 00000100:00100000:1.0:1784583770.816074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025664 00000100:00100000:1.0:1784583770.816131:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784583770.816140:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca92372e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599025664:12345-0@lo:101: 00010000:00010000:1.0:1784583770.816155:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583770.816516:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e714f28b/0xdab2421a42e4761f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47618 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.816543:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e714f28b/0xdab2421a42e4761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47618 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.816553:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e714f28b/0xdab2421a42e4761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47618 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.816561:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e714f28b, rc 0) 00000100:00100000:1.0:1784583770.817459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca92372e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599025664:12345-0@lo:101: Request processed in 1317us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583770.817492:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784583770.817942:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025664:0@lo:101: 00010000:00010000:0.0:1784583770.817967:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.817978:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583770.818409:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025792:0@lo:501: 00000100:00100000:1.0:1784583770.818448:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583770.818507:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000329803ba going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.818566:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025792 00000100:00100000:0.0:1784583770.818571:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025792 00000100:00100000:0.0:1784583770.818610:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784583770.818617:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008369885a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599025792:12345-0@lo:501: 00000100:00100000:0.0:1784583770.819972:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008369885a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599025792:12345-0@lo:501: Request processed in 1351us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.819984:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784583770.820088:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025792:0@lo:501: 00000100:00100000:1.0:1784583770.820129:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025920:0@lo:503: 00000100:00100000:1.0:1784583770.820171:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583770.820196:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000329803ba going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.820236:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599025920 00000100:00100000:0.0:1784583770.820241:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599025920 00000100:00100000:0.0:1784583770.820276:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784583770.820283:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc80ae13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599025920:12345-0@lo:503: 00000100:00100000:0.0:1784583770.820374:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc80ae13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599025920:12345-0@lo:503: Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.820381:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784583770.820446:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599025920:0@lo:503: 00000100:00100000:1.0:1784583770.820937:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7838:1871271599026048:0@lo:502: 00000100:00100000:1.0:1784583770.820972:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583770.820998:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b5c764f0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.821950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026048 00000100:00100000:0.0:1784583770.821958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026048 00000100:00100000:0.0:1784583770.821998:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784583770.822005:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e41531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:7838:x1871271599026048:12345-0@lo:502: 00000100:00100000:0.0:1784583770.822109:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e41531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:7838:x1871271599026048:12345-0@lo:502: Request processed in 105us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.822116:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784583770.822451:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7838:1871271599026048:0@lo:502: 00000020:01000000:2.0:1784583770.822515:0:7838:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583770.822526:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583770.822529:0:7838:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784583770.822534:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784583770.822538:0:7838:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:2.0:1784583770.822564:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784583770.822577:0:7838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000020c8740f) 00000020:00000080:2.0:1784583770.822596:0:7838:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1784583770.822602:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784583770.822684:0:7838:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784583770.822690:0:7838:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784583770.822698:0:7838:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e4762d 00010000:00080000:2.0:1784583770.822744:0:7838:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a08aa71c@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784583770.824970:0:7838:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1784583770.830107:0:7838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784583770.830121:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784583770.830152:0:7838:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784583770.830189:0:7838:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e47634 00000100:00080000:2.0:1784583770.830199:0:7838:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784583770.830204:0:7838:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a08aa71c using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583770.830344:0:7838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce36030e x1871271599026176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784583770.830388:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce36030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599026176:0@lo:38: 00000100:00100000:1.0:1784583770.830446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784583770.830533:0:7838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1784583770.830575:0:7838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784583770.830615:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599026304:0@lo:400: 00000100:00100000:0.0:1784583770.830645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.830675:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026176 00000100:00100000:0.0:1784583770.830681:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000fb7e088 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599026432:0@lo:400: 00000100:00100000:3.0:1784583770.830682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026176 00000100:00100000:0.0:1784583770.830701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.830704:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026432 00000100:00100000:3.0:1784583770.830706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026432 00000100:00100000:0.0:1784583770.830713:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583770.830717:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599026560:0@lo:400: 00000100:00100000:3.0:1784583770.830727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784583770.830733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.830734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057d06309 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599026176:12345-0@lo:38: 00010000:00080000:3.0:1784583770.830755:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:0.0:1784583770.830758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026304 00000100:00100000:0.0:1784583770.830761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026304 00000100:00100000:0.0:1784583770.830783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026560 00000020:00000080:3.0:1784583770.830786:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e4763b 00000100:00100000:0.0:1784583770.830786:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026560 00000100:00100000:0.0:1784583770.830797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784583770.830802:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003046eed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599026304:12345-0@lo:400: 00000004:00100000:3.0:1784583770.830809:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784583770.830815:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1784583770.830843:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003046eed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599026304:12345-0@lo:400: Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.830850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784583770.830862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784583770.830866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000242be265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599026560:12345-0@lo:400: 00000100:00100000:0.0:1784583770.830891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000242be265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599026560:12345-0@lo:400: Request processed in 25us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.830896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784583770.830927:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000074e6a5b4 x1871271599026304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583770.830940:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074e6a5b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599026304:0@lo:400: 00010000:00080000:0.0:1784583770.830963:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000094f82e1f x1871271599026560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583770.831358:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599026560:0@lo:400: 00000100:00080000:1.0:1784583770.834634:0:7841:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000919b600f x1871271599026688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583770.834654:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff445620 going to sleep for 0 seconds 00000020:01000000:0.0:1784583770.837355:0:7838:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583770.837367:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583770.837369:0:7838:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784583770.837372:0:7838:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583770.837376:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583770.837377:0:7838:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784583770.837380:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784583770.837382:0:7838:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784583770.837418:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7838:1871271599026816:0@lo:502: 00000100:00100000:0.0:1784583770.837507:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.837546:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000572aa48a going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.837614:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026816 00000100:00100000:2.0:1784583770.837621:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026816 00000100:00100000:2.0:1784583770.837669:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784583770.837677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000809b999f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:7838:x1871271599026816:12345-0@lo:502: 00000100:00100000:2.0:1784583770.837790:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000809b999f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:7838:x1871271599026816:12345-0@lo:502: Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583770.837805:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784583770.837924:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:7838:1871271599026816:0@lo:502: 00000020:01000000:0.0:1784583770.837944:0:7838:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583770.837948:0:7838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583770.837949:0:7838:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784583770.837952:0:7838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1784583770.841261:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784583770.841299:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784583770.841309:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.841321:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000d34f5042/0xdab2421a42e47618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583770.841343:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784583770.841345:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b4331acd40 from 1 10000000:01000000:1.0:1784583770.841348:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784583770.841383:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.841390:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.841457:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583770.841491:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599026944:0@lo:101: 00000100:00100000:1.0:1784583770.841546:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583770.841585:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008709da7a going to sleep for 11 seconds 00000100:00100000:0.0:1784583770.841657:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026944 00000100:00100000:0.0:1784583770.841663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026944 00000100:00100000:0.0:1784583770.841711:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784583770.841718:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044d93fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599026944:12345-0@lo:101: 00010000:00010000:0.0:1784583770.841729:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583770.841741:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a4687e1/0xdab2421a42e47649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47642 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.841903:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a4687e1/0xdab2421a42e47649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47642 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.841915:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a4687e1/0xdab2421a42e47649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47642 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.841934:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a4687e1, rc 0) 00000100:00100000:0.0:1784583770.842006:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044d93fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599026944:12345-0@lo:101: Request processed in 289us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583770.842013:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784583770.842067:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599026944:0@lo:101: 00010000:00010000:1.0:1784583770.842079:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583770.842087:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583770.842214:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599027072:0@lo:501: 00000100:00100000:1.0:1784583770.842238:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583770.842263:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008709da7a going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.842380:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027072 00000100:00100000:2.0:1784583770.842386:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027072 00000100:00100000:2.0:1784583770.842432:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784583770.842438:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000379630ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599027072:12345-0@lo:501: 00000100:00100000:2.0:1784583770.842570:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000379630ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599027072:12345-0@lo:501: Request processed in 133us (332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784583770.842578:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784583770.842652:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599027072:0@lo:501: 10000000:01000000:0.0:1784583770.842677:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784583770.842733:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583770.842740:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000473d624f/0xdab2421a42e47642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784583770.848748:0:6520:0:(import.c:65:import_set_state_nolock()) 000000001de149e3 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784583770.848847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057d06309 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599026176:12345-0@lo:38: Request processed in 18111us (18399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583770.848863:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1784583770.848871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1784583770.848874:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784583770.848884:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784583770.848889:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784583770.848891:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000a08aa71c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583770.848903:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784583770.848913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92036e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599026432:12345-0@lo:400: 00000100:00080000:1.0:1784583770.848915:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ff445620): req@00000000919b600f x1871271599026688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583770.848973:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92036e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599026432:12345-0@lo:400: Request processed in 62us (18270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.848980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784583770.848987:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000fb7e088 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599026432:0@lo:400: 00000100:00100000:0.0:1784583770.849391:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.849432:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff445620 going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.849445:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599026688 00000100:00100000:3.0:1784583770.849451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599026688 00000100:00100000:3.0:1784583770.849500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784583770.849507:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fb7e088 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599026688:12345-0@lo:1000: 00000100:00100000:3.0:1784583770.849569:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fb7e088 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599026688:12345-0@lo:1000: Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.849577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784583770.849596:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000919b600f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599026688:0@lo:1000: 00000040:01000000:0.0:1784583770.849628:0:7841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784583770.849660:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027200:0@lo:1000: 00000100:00100000:0.0:1784583770.849688:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.849708:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026594f6b going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.849748:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027200 00000100:00100000:3.0:1784583770.849753:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027200 00000100:00100000:3.0:1784583770.849782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784583770.849788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074e6a5b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027200:12345-0@lo:1000: 00000100:00100000:1.0:1784583770.849841:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce36030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599026176:0@lo:38: 00000100:00100000:3.0:1784583770.849893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074e6a5b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027200:12345-0@lo:1000: Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.849900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784583770.849934:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027200:0@lo:1000: 00000100:00100000:0.0:1784583770.849982:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027456:0@lo:700: 00000100:00100000:0.0:1784583770.850007:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.850035:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c2d83a9 going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.850057:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027456 00000100:00100000:3.0:1784583770.850062:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027456 00000100:00100000:3.0:1784583770.850093:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583770.850098:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599027328:0@lo:41: 00000100:00100000:3.0:1784583770.850100:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffca584b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027456:12345-0@lo:700: 00000100:00100000:3.0:1784583770.850149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffca584b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027456:12345-0@lo:700: Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.850168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583770.850411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.850412:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027456:0@lo:700: 00000100:00100000:0.0:1784583770.850613:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027584:0@lo:1000: 00000100:00100000:0.0:1784583770.850640:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.850663:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027328 00000100:00100000:0.0:1784583770.850666:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 000000001d9757d5 going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.850669:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027328 00000100:00100000:3.0:1784583770.850688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027584 00000100:00100000:3.0:1784583770.850691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027584 00000100:00100000:3.0:1784583770.850703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583770.850707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aff5f5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599027328:12345-0@lo:41: 00000004:00000024:3.0:1784583770.850728:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784583770.851002:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db063a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599027328:0@lo:41: 00000100:00100000:3.0:1784583770.851118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aff5f5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599027328:12345-0@lo:41: Request processed in 409us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.851126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583770.851140:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583770.851147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006afdb9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027584:12345-0@lo:1000: 00000100:00100000:3.0:1784583770.851199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006afdb9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027584:12345-0@lo:1000: Request processed in 54us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.851205:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784583770.851403:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027584:0@lo:1000: 00000004:00080000:0.0:1784583770.851443:0:7841:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005c2d83a9 with version 0 00000020:00100000:0.0:1784583770.851456:0:7841:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784583770.851461:0:7841:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000094f82e1f x1871271599027840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784583770.851498:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027840:0@lo:1000: 00000100:00100000:0.0:1784583770.851522:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.851543:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048351d8a going to sleep for 11 seconds 00000100:00100000:2.0:1784583770.851567:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027840 00000100:00100000:2.0:1784583770.851572:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027840 00000100:00100000:2.0:1784583770.851608:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784583770.851614:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f66cd169 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7841:x1871271599027840:12345-0@lo:1000: 00000001:00080000:0.0:1784583770.872928:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1784583770.872943:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784583770.873127:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f66cd169 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7841:x1871271599027840:12345-0@lo:1000: Request processed in 21509us (21600us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784583770.873141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1784583770.873222:0:7841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1784583770.873227:0:7841:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784583770.873241:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027840:0@lo:1000: 00000100:00100000:0.0:1784583770.873340:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027968:0@lo:1000: 00000100:00100000:0.0:1784583770.873377:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583770.873412:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026594f6b going to sleep for 11 seconds 00000100:00100000:3.0:1784583770.873572:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599027968 00000100:00100000:3.0:1784583770.873579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599027968 00000100:00100000:3.0:1784583770.873621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583770.873628:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000920764ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7841:x1871271599027968:12345-0@lo:1000: 00000100:00100000:3.0:1784583770.873695:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000920764ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7841:x1871271599027968:12345-0@lo:1000: Request processed in 67us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583770.873701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784583770.873860:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094f82e1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7841:1871271599027968:0@lo:1000: 00000040:00080000:0.0:1784583770.873877:0:7841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1784583770.873908:0:7841:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005c2d83a9 with version 1 00000004:00080000:3.0:1784583770.875908:0:7839:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e713b2ae version 1 rpc_version 1 00000020:00100000:3.0:1784583770.875948:0:7839:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784583770.875957:0:7839:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000044e96b4a x1871271599028224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583770.875996:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7839:1871271599028224:0@lo:1000: 00000100:00100000:3.0:1784583770.876070:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583770.876131:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074e592de going to sleep for 11 seconds 00000100:00100000:1.0:1784583770.876138:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028224 00000100:00100000:1.0:1784583770.876147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028224 00000100:00100000:1.0:1784583770.877321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784583770.877347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fba520c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1871271599028224:12345-0@lo:1000: 00000040:00080000:0.0:1784583770.877624:0:7841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784583770.877677:0:7841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784583770.877681:0:7841:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1784583770.893396:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1784583770.893749:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fba520c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1871271599028224:12345-0@lo:1000: Request processed in 16404us (17676us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784583770.893763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1784583770.893943:0:7839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1784583770.893948:0:7839:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784583770.893965:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e96b4a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7839:1871271599028224:0@lo:1000: 00010000:00010000:2.0:1784583771.309601:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583771.501028:0:7872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583771.501237:0:7872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784583772.333797:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784583772.338888:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec430cfb0 20000000:00000080:3.0:1784583772.338907:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b43e9f7800 uarg=0000000000000000 20000000:01000000:3.0:1784583772.338947:0:7920:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784583772.338955:0:7920:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784583772.339029:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784583772.340333:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784583772.340347:0:7920:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784583772.345835:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583772.347106:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784583772.347142:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1784583772.347157:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1784583772.347174:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784583772.347195:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.347213:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.347220:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.347226:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.347263:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.347276:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 17 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583772.347289:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ea3678d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871271599028352:0@lo:104: 00000100:00100000:2.0:1784583772.350207:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784583772.350291:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.350307:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 17 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583772.350329:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000786bf316 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871271599028480:0@lo:104: 00000100:00100000:2.0:1784583772.350360:0:7920:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f6a837b1 going to sleep for 11 seconds 00000100:00100000:0.0:1784583772.350503:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784583772.350522:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583772.350544:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028352 00000100:00100000:0.0:1784583772.350550:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028352 00000100:00100000:0.0:1784583772.350582:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028480 00000100:00100000:0.0:1784583772.350585:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028480 00000100:00100000:0.0:1784583772.350597:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784583772.350603:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e833327 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:7920:x1871271599028352:12345-0@lo:104: 00010000:00010000:0.0:1784583772.350614:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583772.350815:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784583772.350821:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e833327 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:7920:x1871271599028352:12345-0@lo:104: Request processed in 218us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583772.350828:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784583772.350863:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784583772.350869:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094f82e1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:7920:x1871271599028480:12345-0@lo:104: 00010000:00010000:0.0:1784583772.350876:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583772.350918:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784583772.350922:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094f82e1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:7920:x1871271599028480:12345-0@lo:104: Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583772.350928:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1784583772.351037:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784583772.351043:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351051:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000560e9063 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:3.0:1784583772.351053:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351061:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583772.351066:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583772.351072:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583772.351111:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351125:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583772.351141:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351147:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000560e9063/0xdab2421a42e475b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475bd expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351157:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583772.351159:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351164:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008002e4e8 already unused, calling callback (00000000cdafcdd2) 10000000:00010000:3.0:1784583772.351166:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351172:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583772.351177:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583772.351180:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583772.351190:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351196:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583772.351206:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351211:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 000000008002e4e8/0xdab2421a42e474c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e474cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351225:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583772.351227:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583772.351228:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583772.351243:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cca95ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599028608:0@lo:103: 00000100:00100000:3.0:1784583772.351270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583772.351303:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599028736:0@lo:103: 00000100:00100000:3.0:1784583772.351333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583772.351363:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028608 00000100:00100000:3.0:1784583772.351367:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028608 00010000:00010000:3.0:1784583772.351393:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583772.351411:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028736 00000100:00100000:3.0:1784583772.351413:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028736 00010000:00010000:3.0:1784583772.351421:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 19 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583772.351432:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784583772.351437:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d60e787f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3642:x1871271599028608:12345-0@lo:103: 00010000:00010000:3.0:1784583772.351444:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583772.351448:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 19 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351457:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 19 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351491:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583772.351516:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d60e787f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3642:x1871271599028608:12345-0@lo:103: Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583772.351526:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784583772.351538:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784583772.351542:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044e96b4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3639:x1871271599028736:12345-0@lo:103: 00010000:00010000:3.0:1784583772.351549:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583772.351552:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351560:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 18 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351570:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351577:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351590:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351595:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351600:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351605:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351610:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3def5b1 already unused, calling callback (000000004f9daade) 00010000:00010000:3.0:1784583772.351613:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351624:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351632:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583772.351641:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583772.351773:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044e96b4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3639:x1871271599028736:12345-0@lo:103: Request processed in 229us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583772.351780:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784583772.351813:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cca95ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599028608:0@lo:103: 00000100:00100000:3.0:1784583772.351835:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599028736:0@lo:103: 00010000:00010000:1.0:1784583772.352083:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583772.352256:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e475bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e475b6 expref: 17 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583772.352280:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ea3678d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871271599028352:0@lo:104: 00010000:00010000:2.0:1784583772.352289:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041a0384e/0xdab2421a42e474cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e474c8 expref: 16 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583772.352297:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000786bf316 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871271599028480:0@lo:104: 00010000:00010000:2.0:1784583772.352309:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.352326:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.352332:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583772.352337:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3def5b1/0xdab2421a42e47650 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583772.846987:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000043587dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599028864:0@lo:41: 00000100:00100000:2.0:1784583772.847053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583772.847347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028864 00000100:00100000:2.0:1784583772.847353:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028864 00000100:00100000:2.0:1784583772.847427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784583772.847435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000786bf316 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599028864:12345-0@lo:41: 00000004:00000024:2.0:1784583772.847514:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784583772.847560:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000786bf316 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599028864:12345-0@lo:41: Request processed in 126us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583772.847567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784583772.847644:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000043587dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599028864:0@lo:41: 00010000:00010000:3.0:1784583773.358828:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583774.382894:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583775.405664:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583775.917631:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583775.917665:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f548005 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599028992:0@lo:41: 00000100:00100000:1.0:1784583775.917748:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583775.917816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599028992 00000100:00100000:1.0:1784583775.917823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599028992 00000100:00100000:1.0:1784583775.917866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784583775.917873:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000542f9e91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599028992:12345-0@lo:41: 00000004:00000024:1.0:1784583775.917908:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784583775.917951:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000542f9e91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599028992:12345-0@lo:41: Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583775.917957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784583775.917998:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f548005 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599028992:0@lo:41: 00000100:00100000:1.0:1784583775.918870:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599029504:0@lo:400: 00000100:00100000:1.0:1784583775.918905:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583775.918935:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784583775.918940:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f548005 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599029120:0@lo:400: 00000100:00100000:1.0:1784583775.918964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583775.918988:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000919b600f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599029248:0@lo:400: 00000100:00100000:1.0:1784583775.919007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583775.919022:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583775.919026:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599029376:0@lo:400: 00000100:00100000:1.0:1784583775.919044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583775.919067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029504 00000100:00100000:1.0:1784583775.919071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029504 00000100:00100000:1.0:1784583775.919099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029248 00000100:00100000:1.0:1784583775.919101:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029248 00000100:00100000:1.0:1784583775.919111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784583775.919116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000886eb4d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599029504:12345-0@lo:400: 00000100:00100000:1.0:1784583775.919151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000886eb4d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599029504:12345-0@lo:400: Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583775.919280:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784583775.919305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784583775.919311:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bee68901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599029248:12345-0@lo:400: 00000100:00100000:1.0:1784583775.919345:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bee68901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599029248:12345-0@lo:400: Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583775.919352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784583775.919369:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029120 00000100:00100000:1.0:1784583775.919373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029120 00000100:00100000:1.0:1784583775.919396:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784583775.919401:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b6ca37e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3641:x1871271599029120:12345-0@lo:400: 00000100:00100000:1.0:1784583775.919428:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b6ca37e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3641:x1871271599029120:12345-0@lo:400: Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583775.919434:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1784583775.919498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000919b600f x1871271599029248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583775.919510:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000919b600f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599029248:0@lo:400: 00000100:00100000:1.0:1784583775.919531:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f548005 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599029120:0@lo:400: 00010000:00080000:1.0:1784583775.919538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000678f184b x1871271599029504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583775.919545:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000678f184b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599029504:0@lo:400: 00000100:00100000:1.0:1784583775.919559:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029376 00000100:00100000:1.0:1784583775.919563:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029376 00000100:00100000:1.0:1784583775.919584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784583775.919590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d324a443 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599029376:12345-0@lo:400: 00000100:00100000:1.0:1784583775.919631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d324a443 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599029376:12345-0@lo:400: Request processed in 42us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583775.919638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784583775.919662:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045dda173 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599029376:0@lo:400: 00010000:00010000:1.0:1784583776.430986:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583777.453562:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583777.968318:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000043587dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599029632:0@lo:41: 00000100:00100000:1.0:1784583777.968385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583777.968413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029632 00000100:00100000:0.0:1784583777.968421:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029632 00000100:00100000:0.0:1784583777.968484:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784583777.968493:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045dda173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599029632:12345-0@lo:41: 00000004:00000024:0.0:1784583777.968523:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1784583777.968569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045dda173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599029632:12345-0@lo:41: Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583777.968577:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784583777.969027:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000043587dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599029632:0@lo:41: 00010000:00010000:2.0:1784583778.477642:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784583779.502531:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583779.502539:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b42ba2f000 from 1 10000000:01000000:3.0:1784583779.502543:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784583779.502563:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583779.502586:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000aa998164/0xdab2421a42e47657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.502598:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000aa998164/0xdab2421a42e47657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.502608:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000aa998164/0xdab2421a42e47657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583779.502630:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599029760:0@lo:101: 00000100:00100000:3.0:1784583779.502689:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.502746:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003bf01d1 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.502814:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029760 00000100:00100000:1.0:1784583779.502822:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029760 00000100:00100000:1.0:1784583779.502877:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784583779.502885:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c256c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599029760:12345-0@lo:101: 00010000:00010000:1.0:1784583779.502897:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583779.502909:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e4765e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47657 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583779.502941:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e4765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47657 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583779.502952:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a6ab5c3/0xdab2421a42e4765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47657 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583779.502961:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a6ab5c3, rc 0) 00000100:00100000:1.0:1784583779.502993:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c256c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599029760:12345-0@lo:101: Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.502999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784583779.503165:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599029760:0@lo:101: 00010000:00010000:3.0:1784583779.503177:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000aa998164/0xdab2421a42e47657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.503185:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000aa998164/0xdab2421a42e47657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583779.503233:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599029888:0@lo:501: 00000100:00100000:3.0:1784583779.503258:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.503286:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003bf01d1 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.503325:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599029888 00000100:00100000:1.0:1784583779.503336:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599029888 00000100:00100000:1.0:1784583779.503365:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784583779.503371:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d536e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599029888:12345-0@lo:501: 00000100:00100000:1.0:1784583779.503493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d536e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599029888:12345-0@lo:501: Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.503500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784583779.503578:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599029888:0@lo:501: 00000100:00100000:3.0:1784583779.503603:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030016:0@lo:503: 00000100:00100000:3.0:1784583779.503640:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.503664:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003bf01d1 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.503718:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030016 00000100:00100000:1.0:1784583779.503722:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030016 00000100:00100000:1.0:1784583779.503750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784583779.503756:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074607d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599030016:12345-0@lo:503: 00000100:00100000:1.0:1784583779.503829:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074607d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599030016:12345-0@lo:503: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.503836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784583779.503908:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004475a84f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030016:0@lo:503: 00000100:00100000:0.0:1784583779.507610:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009ba5f85e pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8301:1871271599030144:0@lo:502: 00000100:00100000:0.0:1784583779.507692:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583779.507731:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008571d79 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.510379:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030144 00000100:00100000:1.0:1784583779.510391:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030144 00000100:00100000:1.0:1784583779.510446:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784583779.510453:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dccabd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8301:x1871271599030144:12345-0@lo:502: 00000100:00100000:1.0:1784583779.510648:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dccabd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8301:x1871271599030144:12345-0@lo:502: Request processed in 195us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.510656:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784583779.510838:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009ba5f85e pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8301:1871271599030144:0@lo:502: 00000020:01000000:2.0:1784583779.510870:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583779.510878:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583779.510880:0:8301:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784583779.510886:0:8301:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b42ba2f000 00000020:00000080:2.0:1784583779.510888:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784583779.510932:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8301:1871271599030272:0@lo:502: 00000100:00100000:2.0:1784583779.510982:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583779.511011:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32180 going to sleep for 11 seconds 00000100:00100000:0.0:1784583779.511088:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030272 00000100:00100000:0.0:1784583779.511093:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030272 00000100:00100000:0.0:1784583779.511129:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784583779.511136:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8301:x1871271599030272:12345-0@lo:502: 00000100:00100000:0.0:1784583779.511212:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8301:x1871271599030272:12345-0@lo:502: Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583779.511218:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784583779.511452:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8301:1871271599030272:0@lo:502: 00000020:01000000:2.0:1784583779.511489:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583779.511493:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583779.511495:0:8301:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784583779.511498:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1784583779.512024:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784583779.512044:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583779.512052:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.512073:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583779.512082:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583779.512085:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b418942800 from 1 10000000:01000000:3.0:1784583779.512087:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583779.512109:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.512124:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.512133:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583779.512145:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030400:0@lo:101: 00000100:00100000:3.0:1784583779.512176:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.512204:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1784583779.513184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030400 00000100:00100000:0.0:1784583779.513192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030400 00000100:00100000:0.0:1784583779.513237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784583779.513246:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599030400:12345-0@lo:101: 00010000:00010000:0.0:1784583779.513258:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583779.513288:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47665 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583779.513312:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47665 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583779.513322:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47665 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583779.513330:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216b000, rc 0) 00000100:00100000:0.0:1784583779.513385:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599030400:12345-0@lo:101: Request processed in 139us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583779.513391:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784583779.513572:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030400:0@lo:101: 00010000:00010000:3.0:1784583779.513588:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.513596:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583779.513647:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030528:0@lo:501: 00000100:00100000:3.0:1784583779.513675:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.513704:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.513757:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030528 00000100:00100000:1.0:1784583779.513761:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030528 00000100:00100000:1.0:1784583779.513794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784583779.513800:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599030528:12345-0@lo:501: 00000100:00100000:1.0:1784583779.513903:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599030528:12345-0@lo:501: Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.513909:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784583779.514048:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030528:0@lo:501: 00000100:00100000:3.0:1784583779.514082:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030656:0@lo:503: 00000100:00100000:3.0:1784583779.514116:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583779.514138:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1784583779.514192:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030656 00000100:00100000:0.0:1784583779.514196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030656 00000100:00100000:0.0:1784583779.514227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784583779.514234:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599030656:12345-0@lo:503: 00000100:00100000:0.0:1784583779.514320:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599030656:12345-0@lo:503: Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583779.514326:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784583779.515014:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599030656:0@lo:503: 00000100:00100000:0.0:1784583779.518538:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8302:1871271599030784:0@lo:502: 00000100:00100000:0.0:1784583779.518617:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583779.518652:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.518732:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030784 00000100:00100000:1.0:1784583779.518738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030784 00000100:00100000:1.0:1784583779.518789:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784583779.518797:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8302:x1871271599030784:12345-0@lo:502: 00000100:00100000:1.0:1784583779.518920:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8302:x1871271599030784:12345-0@lo:502: Request processed in 115us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.518929:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784583779.518942:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8302:1871271599030784:0@lo:502: 00000020:01000000:0.0:1784583779.518965:0:8302:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583779.518974:0:8302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583779.518976:0:8302:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784583779.518983:0:8302:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b418942800 00000020:00000080:0.0:1784583779.518986:0:8302:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784583779.519013:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8302:1871271599030912:0@lo:502: 00000100:00100000:0.0:1784583779.519044:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583779.519069:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784583779.519124:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599030912 00000100:00100000:1.0:1784583779.519128:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599030912 00000100:00100000:1.0:1784583779.519158:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784583779.519165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8302:x1871271599030912:12345-0@lo:502: 00000100:00100000:1.0:1784583779.519232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8302:x1871271599030912:12345-0@lo:502: Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583779.519238:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784583779.519318:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8302:1871271599030912:0@lo:502: 00000020:01000000:0.0:1784583779.519335:0:8302:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583779.519339:0:8302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583779.519340:0:8302:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784583779.519344:0:8302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1784583779.519537:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784583779.519562:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583779.519571:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583779.519582:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583780.528795:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583781.052495:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583781.052520:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599031040:0@lo:41: 00000100:00100000:3.0:1784583781.052585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.052621:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599031296:0@lo:400: 00000100:00100000:3.0:1784583781.052629:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599031168:0@lo:400: 00000100:00100000:0.0:1784583781.052650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583781.052651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583781.052670:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599031680:0@lo:400: 00000100:00100000:0.0:1784583781.052672:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583781.052676:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599031424:0@lo:400: 00000100:00100000:3.0:1784583781.052687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583781.052705:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583781.052705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031296 00000100:00100000:3.0:1784583781.052709:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599031552:0@lo:400: 00000100:00100000:0.0:1784583781.052710:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031296 00000100:00100000:3.0:1784583781.052731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.052748:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031552 00000100:00100000:0.0:1784583781.052750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031552 00000100:00100000:3.0:1784583781.052753:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031040 00000100:00100000:3.0:1784583781.052756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031040 00000100:00100000:0.0:1784583781.052765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784583781.052771:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031680 00000100:00100000:3.0:1784583781.052773:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031680 00000100:00100000:0.0:1784583781.052773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599031296:12345-0@lo:400: 00000100:00100000:3.0:1784583781.052782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784583781.052788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599031040:12345-0@lo:41: 00000004:00000024:3.0:1784583781.052810:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1784583781.052816:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599031296:12345-0@lo:400: Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.052823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784583781.052839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784583781.052840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599031040:12345-0@lo:41: Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.052844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599031552:12345-0@lo:400: 00000100:00100000:3.0:1784583781.052845:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784583781.052856:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784583781.052868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599031680:12345-0@lo:400: 00000100:00100000:0.0:1784583781.052868:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599031552:12345-0@lo:400: Request processed in 24us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.052874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784583781.052892:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599031680:12345-0@lo:400: Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.052897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784583781.052913:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031168 00000100:00100000:3.0:1784583781.052916:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031168 00000100:00100000:3.0:1784583781.052944:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784583781.052950:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3640:x1871271599031168:12345-0@lo:400: 00000100:00100000:3.0:1784583781.052977:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3640:x1871271599031168:12345-0@lo:400: Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.052983:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784583781.053014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784583781.053044:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b40a51ce00 x1871271599031296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583781.053058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599031296:0@lo:400: 00000100:00100000:3.0:1784583781.053080:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031424 00000100:00100000:3.0:1784583781.053083:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031424 00000100:00100000:3.0:1784583781.053099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784583781.053104:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599031424:12345-0@lo:400: 00000100:00100000:3.0:1784583781.053130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599031424:12345-0@lo:400: Request processed in 26us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.053135:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784583781.054938:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599031424:0@lo:400: 00010000:00080000:3.0:1784583781.054976:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b40a51ed80 x1871271599031552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583781.054986:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599031552:0@lo:400: 00000100:00100000:3.0:1784583781.055014:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599031168:0@lo:400: 00000100:00100000:3.0:1784583781.055025:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599031680:0@lo:400: 00000100:00100000:3.0:1784583781.055040:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599031040:0@lo:41: 00000020:01000004:1.0:1784583781.352536:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784583781.352541:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784583781.352542:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784583781.352672:0:8420:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b43e967000 00000020:01000004:1.0:1784583781.352688:0:8420:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784583781.352701:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784583781.352724:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98b43ea64d40) 00000020:00000080:1.0:1784583781.352742:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784583781.398205:0:8420:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784583781.398254:0:8420:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1784583781.410025:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784583781.410213:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784583781.410224:0:8420:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784583781.410234:0:8420:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e4767a 00000020:01000004:3.0:1784583781.410241:0:8420:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784583781.410271:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784583781.410275:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784583781.410281:0:8420:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784583781.410286:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784583781.410297:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98b42e933380) 00000020:00000080:3.0:1784583781.410307:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1784583781.414924:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784583781.415100:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784583781.415106:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784583781.422078:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784583781.422091:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784583781.423135:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784583781.423144:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784583781.427429:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784583781.428004:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784583781.428010:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784583781.431549:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784583781.431566:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784583781.459026:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784583781.459244:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784583781.459250:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784583781.460254:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784583781.460272:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784583781.462302:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784583781.462317:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784583781.464816:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784583781.464985:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784583781.464991:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784583781.465928:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784583781.465939:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784583781.521174:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784583781.521511:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784583781.521518:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784583781.522815:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784583781.522826:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784583781.523220:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784583781.523247:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784583781.523253:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784583781.539980:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784583781.540025:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1784583781.540030:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784583781.540031:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784583781.540033:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784583781.540034:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784583781.540035:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784583781.540036:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784583781.540038:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784583781.540039:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784583781.540040:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784583781.540041:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784583781.540043:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784583781.540047:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1784583781.540049:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784583781.540050:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784583781.540051:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784583781.540052:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784583781.540053:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784583781.540054:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784583781.540055:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784583781.540056:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784583781.540057:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784583781.540058:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784583781.540059:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784583781.540085:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784583781.540107:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599031808:0@lo:253: 00000100:00100000:1.0:1784583781.540589:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583781.540774:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031808 00000100:00100000:2.0:1784583781.540781:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031808 00000100:00100000:2.0:1784583781.540859:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784583781.540868:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8420:x1871271599031808:12345-0@lo:253: 20000000:01000000:2.0:1784583781.540896:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784583781.540900:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1784583781.540905:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1784583781.540908:0:6507:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1784583781.541079:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583781.541198:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1784583781.541209:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1784583781.541222:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1784583781.541226:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1784583781.541235:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1784583781.541281:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1784583781.541354:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1784583781.541368:0:6507:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583781.541370:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583781.541396:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1784583781.541402:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784583781.541415:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1784583781.541420:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583781.541431:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1784583781.541436:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784583781.541446:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784583781.541459:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784583781.541549:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1784583781.541559:0:6507:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583781.541561:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583781.541575:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1784583781.541579:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784583781.541591:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1784583781.541595:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583781.541836:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1784583781.541845:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784583781.541861:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1784583781.541876:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1784583781.542250:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1784583781.542276:0:6507:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583781.542278:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583781.542294:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1784583781.542299:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784583781.542310:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1784583781.542314:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583781.542326:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1784583781.542339:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784583781.542353:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1784583781.542369:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1784583781.542450:0:6507:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784583781.542454:0:6507:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784583781.542457:0:6507:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784583781.542898:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784583781.542901:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:2.0:1784583781.543221:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51480 going to sleep for 11 seconds 20000000:01000000:2.0:1784583781.544738:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1784583781.544782:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1784583781.544799:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784583781.545031:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1784583781.545051:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1784583781.545064:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1784583781.545073:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784583781.545076:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784583781.545697:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1784583781.545727:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1784583781.545743:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1784583781.545904:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1784583781.545945:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1784583781.545962:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1784583781.545972:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784583781.545974:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784583781.546341:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784583781.546866:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784583781.546885:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784583781.546897:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784583781.546904:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784583781.546906:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784583781.547201:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1784583781.547223:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1784583781.547237:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1784583781.547464:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1784583781.547522:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1784583781.547538:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1784583781.547555:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784583781.547575:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547593:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4754d expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547602:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547676:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475fc expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547694:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47618 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547701:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47642 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547708:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547746:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547759:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 18 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.547773:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599031936:0@lo:104: 00000100:00100000:1.0:1784583781.547831:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583781.547880:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547889:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.547897:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032064:0@lo:104: 00000100:00100000:1.0:1784583781.547917:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583781.547949:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.547958:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.547973:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032192:0@lo:104: 00000100:00100000:1.0:1784583781.547995:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583781.548013:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.548021:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.548030:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032320:0@lo:104: 00000100:00100000:1.0:1784583781.548049:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583781.548066:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.548074:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.548083:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032448:0@lo:104: 00000100:00100000:1.0:1784583781.548115:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.548126:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51180 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.548214:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599031936 00000100:00100000:2.0:1784583781.548221:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599031936 00000100:00100000:2.0:1784583781.548254:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032064 00000100:00100000:2.0:1784583781.548269:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032064 00000100:00100000:2.0:1784583781.548281:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032192 00000100:00100000:2.0:1784583781.548284:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032192 00000100:00100000:2.0:1784583781.548294:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032320 00000100:00100000:2.0:1784583781.548296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032320 00000100:00100000:2.0:1784583781.548304:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032448 00000100:00100000:2.0:1784583781.548306:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032448 00000100:00100000:2.0:1784583781.548318:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784583781.548326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6507:x1871271599031936:12345-0@lo:104: 00010000:00010000:2.0:1784583781.548337:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548493:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583781.548505:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6507:x1871271599031936:12345-0@lo:104: Request processed in 180us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.548512:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784583781.548528:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784583781.548533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6507:x1871271599032064:12345-0@lo:104: 00010000:00010000:2.0:1784583781.548541:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548574:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583781.548580:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6507:x1871271599032064:12345-0@lo:104: Request processed in 47us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.548585:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784583781.548596:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784583781.548602:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6507:x1871271599032192:12345-0@lo:104: 00010000:00010000:2.0:1784583781.548676:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548703:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784583781.548708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6507:x1871271599032192:12345-0@lo:104: Request processed in 106us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.548713:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784583781.548724:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784583781.548729:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6507:x1871271599032320:12345-0@lo:104: 00010000:00010000:2.0:1784583781.548735:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548756:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784583781.548766:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6507:x1871271599032320:12345-0@lo:104: Request processed in 37us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.548771:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784583781.548782:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784583781.548787:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6507:x1871271599032448:12345-0@lo:104: 00010000:00010000:2.0:1784583781.548793:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548818:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784583781.548821:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6507:x1871271599032448:12345-0@lo:104: Request processed in 36us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.548826:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1784583781.548841:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784583781.548846:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548852:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.548855:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548866:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.548872:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.548877:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.548900:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548917:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.548935:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548941:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e47642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47649 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548953:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784583781.548956:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548961:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b400030600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.548963:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548969:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.548974:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.548978:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.548993:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.548998:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.549002:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549008:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b400030600/0xdab2421a42e47618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4761f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549022:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784583781.549025:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549030:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b442047c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.549032:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549040:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.549045:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.549049:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.549059:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549064:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.549076:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549082:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b442047c00/0xdab2421a42e475fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47603 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549090:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784583781.549092:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549107:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b400031600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.549110:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549115:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.549121:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.549125:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.549135:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549140:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.549144:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549150:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b400031600/0xdab2421a42e475c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475cb expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549158:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583781.549161:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549166:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b442046200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.549168:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549182:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.549188:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.549193:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.549203:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549208:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.549212:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549217:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b442046200/0xdab2421a42e4754d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47554 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.549228:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.549230:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.549231:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.549237:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583781.549248:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599032576:0@lo:103: 00000100:00100000:2.0:1784583781.549292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583781.549320:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599033088:0@lo:103: 00000100:00100000:2.0:1784583781.549362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.549747:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599031936:0@lo:104: 00000100:00100000:1.0:1784583781.549760:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032064:0@lo:104: 00000100:00100000:1.0:1784583781.549767:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032192:0@lo:104: 00000100:00100000:1.0:1784583781.549774:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032320:0@lo:104: 00000100:00100000:1.0:1784583781.549782:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1871271599032448:0@lo:104: 00010000:00010000:1.0:1784583781.549806:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.549992:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599032832:0@lo:103: 00000100:00100000:1.0:1784583781.550023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.550062:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583781.550068:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599032960:0@lo:103: 00000100:00100000:1.0:1784583781.550085:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.550101:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599032704:0@lo:103: 00000100:00100000:1.0:1784583781.550120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583781.550244:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032576 00000100:00100000:3.0:1784583781.550251:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032576 00010000:00010000:3.0:1784583781.550294:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 19 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583781.550323:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033088 00000100:00100000:3.0:1784583781.550326:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033088 00010000:00010000:3.0:1784583781.550337:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 20 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583781.550346:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032832 00000100:00100000:3.0:1784583781.550348:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032832 00010000:00010000:3.0:1784583781.550356:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 21 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583781.550364:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032960 00000100:00100000:3.0:1784583781.550366:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032960 00010000:00010000:3.0:1784583781.550374:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 22 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583781.550462:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599032704 00000100:00100000:3.0:1784583781.550490:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599032704 00010000:00010000:3.0:1784583781.550505:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 23 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583781.550518:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784583781.550527:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3641:x1871271599032576:12345-0@lo:103: 00010000:00010000:3.0:1784583781.550537:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583781.550543:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 23 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550553:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 23 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550567:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b400031a00/0xdab2421a42e47649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47642 expref: 23 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550587:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583781.550732:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3641:x1871271599032576:12345-0@lo:103: Request processed in 206us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.550739:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784583781.550755:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784583781.550761:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3641:x1871271599033088:12345-0@lo:103: 00010000:00010000:3.0:1784583781.550769:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583781.550773:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 21 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550781:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 21 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550790:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983e00/0xdab2421a42e47554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4754d expref: 21 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583781.550800:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583781.551071:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599032576:0@lo:103: 00000100:00100000:0.0:1784583781.551131:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784583781.551140:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1784583781.551155:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784583781.551178:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784583781.551186:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:3639:x1871271599032832:12345-0@lo:103: 00010000:00010000:0.0:1784583781.551196:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583781.551201:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 20 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551210:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 20 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551221:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b400031c00/0xdab2421a42e47603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e475fc expref: 20 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551229:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583781.551278:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3639:x1871271599032832:12345-0@lo:103: Request processed in 92us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.551285:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784583781.551298:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784583781.551304:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784583781.551309:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3639:x1871271599032960:12345-0@lo:103: 00010000:00010000:0.0:1784583781.551316:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583781.551320:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551339:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551349:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983c00/0xdab2421a42e475cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e475c4 expref: 18 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551358:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583781.551464:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3639:x1871271599032960:12345-0@lo:103: Request processed in 153us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.551495:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784583781.551509:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784583781.551516:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784583781.551522:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3642:x1871271599032704:12345-0@lo:103: 00010000:00010000:0.0:1784583781.551530:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583781.551535:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 16 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551543:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 16 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551554:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982e00/0xdab2421a42e4761f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47618 expref: 16 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551566:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551574:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551598:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551679:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551689:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551696:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551703:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583781.551707:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551716:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551729:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.551741:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583781.551767:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3642:x1871271599032704:12345-0@lo:103: Request processed in 245us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.551773:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784583781.551870:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599032704:0@lo:103: 00000100:00100000:1.0:1784583781.551894:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599032960:0@lo:103: 00000100:00100000:1.0:1784583781.551902:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599032832:0@lo:103: 00010000:00010000:1.0:1784583781.551918:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.551925:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.551932:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982800/0xdab2421a42e47688 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784583781.551944:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784583781.553505:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:8420:x1871271599031808:12345-0@lo:253: Request processed in 12631us (12910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.553516:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784583781.553710:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599031808:0@lo:253: 10000000:01000000:0.0:1784583781.553723:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784583781.553726:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784583781.553735:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784583781.553736:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784583781.553738:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1784583781.553739:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784583781.553741:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784583781.553742:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784583781.553744:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784583781.553745:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784583781.553746:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784583781.553766:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b43e967000 from lustre-OST0000 10000000:01000000:0.0:1784583781.553804:0:8420:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784583781.553807:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784583781.553815:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b4331acd40 local copy 10000000:01000000:0.0:1784583781.553819:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784583781.553851:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.553860:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.553869:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.553884:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033216:0@lo:101: 00000100:00100000:0.0:1784583781.553913:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.553948:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.553992:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033216 00000100:00100000:1.0:1784583781.553998:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033216 00000100:00100000:1.0:1784583781.554050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784583781.554058:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:8420:x1871271599033216:12345-0@lo:101: 00010000:00010000:1.0:1784583781.554068:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583781.554080:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982c00/0xdab2421a42e47696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4768f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554100:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982c00/0xdab2421a42e47696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4768f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554110:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982c00/0xdab2421a42e47696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4768f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554117:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982c00, rc 0) 00000100:00100000:1.0:1784583781.554146:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599033216:12345-0@lo:101: Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.554151:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784583781.554221:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033216:0@lo:101: 00010000:00010000:0.0:1784583781.554233:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.554242:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.554338:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033344:0@lo:501: 00000100:00100000:0.0:1784583781.554362:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.554390:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.554600:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033344 00000100:00100000:1.0:1784583781.554667:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033344 00000100:00100000:1.0:1784583781.554699:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784583781.554706:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599033344:12345-0@lo:501: 00000100:00100000:1.0:1784583781.554765:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599033344:12345-0@lo:501: Request processed in 59us (401us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784583781.554771:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784583781.554804:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033344:0@lo:501: 10000000:01000000:1.0:1784583781.554814:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784583781.554831:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784583781.554836:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554855:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554862:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554879:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784583781.554900:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b43e967000 10000000:01000000:1.0:1784583781.554905:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784583781.554910:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784583781.554912:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784583781.554916:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784583781.554919:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784583781.554935:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554943:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.554950:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.554962:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033472:0@lo:101: 00000100:00100000:1.0:1784583781.554989:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.555000:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583781.555047:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033472 00000100:00100000:0.0:1784583781.555052:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033472 00000100:00100000:0.0:1784583781.555078:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784583781.555083:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599033472:12345-0@lo:101: 00010000:00010000:0.0:1784583781.555090:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583781.555098:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4769d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.555111:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4769d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.555119:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4769d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.555125:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a200, rc 0) 00000100:00100000:0.0:1784583781.555149:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033472:12345-0@lo:101: Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.555154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784583781.555243:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033472:0@lo:101: 00010000:00010000:1.0:1784583781.555253:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.555285:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.555340:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033600:0@lo:501: 00000100:00100000:1.0:1784583781.555362:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.555393:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.555405:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033600 00000100:00100000:1.0:1784583781.555408:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033600 00000100:00100000:1.0:1784583781.555427:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784583781.555432:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033600:12345-0@lo:501: 00000100:00100000:1.0:1784583781.555526:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033600:12345-0@lo:501: Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.555532:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784583781.555561:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033600:0@lo:501: 00000100:00100000:1.0:1784583781.555582:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033728:0@lo:503: 00000100:00100000:1.0:1784583781.555740:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.555753:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.555763:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033728 00000100:00100000:1.0:1784583781.555766:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033728 00000100:00100000:1.0:1784583781.555784:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784583781.555789:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033728:12345-0@lo:503: 00000100:00100000:1.0:1784583781.555848:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033728:12345-0@lo:503: Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.555853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784583781.555887:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033728:0@lo:503: 00000040:00080000:1.0:1784583781.556081:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784583781.556144:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033856:0@lo:502: 00000100:00100000:1.0:1784583781.556175:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.556187:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.556198:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033856 00000100:00100000:1.0:1784583781.556200:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033856 00000100:00100000:1.0:1784583781.556218:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784583781.556223:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033856:12345-0@lo:502: 00000100:00100000:1.0:1784583781.556316:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599033856:12345-0@lo:502: Request processed in 92us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.556323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784583781.556370:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033856:0@lo:502: 00000100:00100000:3.0:1784583781.556498:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3641:x1871271599033088:12345-0@lo:103: Request processed in 5736us (7135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.556506:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:1.0:1784583781.556833:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784583781.556857:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784583781.556869:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784583781.556880:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784583781.556890:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784583781.556901:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784583781.556920:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033984:0@lo:502: 00000100:00100000:1.0:1784583781.556953:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.557058:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.557403:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599033088:0@lo:103: 00010000:00010000:2.0:1784583781.557453:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583781.557459:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.557496:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a400 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583781.557500:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.557508:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583781.557515:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583781.557520:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583781.557541:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.557547:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583781.557566:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.557573:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b44216a400/0xdab2421a42e4768f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e47696 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.557586:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.557588:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.557590:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583781.557596:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583781.557771:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599034112:0@lo:103: 00000100:00100000:1.0:1784583781.557804:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.557843:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034112 00000100:00100000:1.0:1784583781.557849:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034112 00000100:00100000:1.0:1784583781.557887:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583781.557895:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3642:x1871271599034112:12345-0@lo:103: 00010000:00010000:1.0:1784583781.557912:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583781.557926:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982c00/0xdab2421a42e47696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4768f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.557938:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583781.557967:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3642:x1871271599034112:12345-0@lo:103: Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.557974:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583781.557999:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599034112:0@lo:103: 00000100:00100000:3.0:1784583781.558462:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599033984 00000100:00100000:3.0:1784583781.558487:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599033984 00000100:00100000:3.0:1784583781.558513:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784583781.558518:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:8420:x1871271599033984:12345-0@lo:502: 00000100:00100000:3.0:1784583781.558786:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:8420:x1871271599033984:12345-0@lo:502: Request processed in 265us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.558793:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784583781.558902:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599033984:0@lo:502: 00000040:00080000:1.0:1784583781.558964:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784583781.558976:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784583781.560996:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784583781.561008:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784583781.561015:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583781.561018:0:8444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784583781.561024:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784583781.561053:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98b30247cd40) 00000020:00000080:3.0:1784583781.561075:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784583781.561081:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784583781.561147:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b43e967000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784583781.561154:0:8444:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784583781.561159:0:8444:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e476b2 00010000:00010000:3.0:1784583781.567342:0:8444:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1784583781.567860:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784583781.572366:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784583781.572947:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784583781.580826:0:8444:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784583781.580998:0:8444:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1784583781.591994:0:8444:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1784583781.594885:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784583781.594898:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583781.594906:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583781.594908:0:8444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784583781.594913:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583781.594917:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583781.594919:0:8444:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784583781.594931:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784583781.594933:0:8444:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784583781.594958:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583781.594961:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583781.594963:0:8444:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784583781.594967:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784583781.595122:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784583781.595152:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784583781.595174:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.595186:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583781.595193:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b43e967000 from 1 10000000:01000000:1.0:1784583781.595196:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784583781.595230:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.595238:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.595249:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.595360:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034240:0@lo:101: 00000100:00100000:1.0:1784583781.595509:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.595561:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.595692:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034240 00000100:00100000:2.0:1784583781.595699:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034240 00000100:00100000:2.0:1784583781.595750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784583781.595759:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:8420:x1871271599034240:12345-0@lo:101: 00010000:00010000:2.0:1784583781.595773:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583781.595784:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e476b9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.595806:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.595817:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.595825:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ae00, rc 0) 00000100:00100000:2.0:1784583781.595860:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034240:12345-0@lo:101: Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.595866:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784583781.595959:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034240:0@lo:101: 00010000:00010000:1.0:1784583781.595973:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.595982:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.596056:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034368:0@lo:501: 00000100:00100000:1.0:1784583781.596081:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.596189:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.600532:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034368 00000100:00100000:2.0:1784583781.600545:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034368 00000100:00100000:2.0:1784583781.600596:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784583781.602282:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034368:12345-0@lo:501: 00000100:00100000:2.0:1784583781.602487:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034368:12345-0@lo:501: Request processed in 1881us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.602496:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784583781.603099:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034368:0@lo:501: 00000100:00100000:1.0:1784583781.603152:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034496:0@lo:503: 00000100:00100000:1.0:1784583781.603202:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.603800:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.605445:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034496 00000100:00100000:2.0:1784583781.605456:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034496 00000100:00100000:0.0:1784583781.605825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784583781.605836:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034496:12345-0@lo:503: 00000100:00100000:0.0:1784583781.605993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034496:12345-0@lo:503: Request processed in 157us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.606001:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784583781.606091:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034496:0@lo:503: 00000040:00080000:2.0:1784583781.606340:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784583781.606419:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034624:0@lo:502: 00000100:00100000:2.0:1784583781.606499:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583781.606872:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.606954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034624 00000100:00100000:1.0:1784583781.606960:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034624 00000100:00100000:1.0:1784583781.606990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784583781.606998:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034624:12345-0@lo:502: 00000100:00100000:1.0:1784583781.607106:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034624:12345-0@lo:502: Request processed in 108us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.607114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784583781.607192:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034624:0@lo:502: 00000040:00080000:2.0:1784583781.607421:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784583781.607449:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784583781.607501:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034752:0@lo:502: 00000100:00100000:2.0:1784583781.607537:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583781.607553:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.607807:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034752 00000100:00100000:1.0:1784583781.607817:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034752 00000100:00100000:1.0:1784583781.607837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784583781.607842:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034752:12345-0@lo:502: 00000100:00100000:1.0:1784583781.607904:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034752:12345-0@lo:502: Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.607910:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784583781.607989:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034752:0@lo:502: 00000040:00080000:2.0:1784583781.608027:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784583781.608036:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784583781.608836:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583781.608845:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583781.608847:0:8448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784583781.608852:0:8448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b43e967000 00000020:00000080:2.0:1784583781.608855:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784583781.608864:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583781.608866:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583781.608867:0:8448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784583781.608870:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784583781.608976:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784583781.608998:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784583781.609018:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609029:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583781.609076:0:8420:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784583781.609080:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b43e967000 10000000:01000000:1.0:1784583781.609083:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b43e967000 10000000:01000000:1.0:1784583781.609086:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784583781.609091:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b43e967000 from 1 10000000:01000000:1.0:1784583781.609093:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784583781.609117:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609124:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609134:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.609148:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034880:0@lo:101: 00000100:00100000:1.0:1784583781.609193:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.609221:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51000 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.609237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599034880 00000100:00100000:1.0:1784583781.609242:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599034880 00000100:00100000:1.0:1784583781.609342:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784583781.609351:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8420:x1871271599034880:12345-0@lo:101: 00010000:00010000:1.0:1784583781.609362:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583781.609373:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e476c7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609464:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609500:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609508:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983200, rc 0) 00000100:00100000:1.0:1784583781.609538:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599034880:12345-0@lo:101: Request processed in 189us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.609544:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784583781.609582:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599034880:0@lo:101: 00010000:00010000:1.0:1784583781.609593:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.609601:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.609996:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035008:0@lo:501: 00000100:00100000:1.0:1784583781.610030:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.610052:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51000 going to sleep for 11 seconds 00000100:00100000:0.0:1784583781.610112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035008 00000100:00100000:0.0:1784583781.610117:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035008 00000100:00100000:0.0:1784583781.610145:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784583781.610152:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035008:12345-0@lo:501: 00000100:00100000:0.0:1784583781.610255:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035008:12345-0@lo:501: Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.610273:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784583781.610457:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035008:0@lo:501: 00000100:00100000:1.0:1784583781.610508:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035136:0@lo:503: 00000100:00100000:1.0:1784583781.610542:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.610566:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51000 going to sleep for 11 seconds 00000100:00100000:2.0:1784583781.610678:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035136 00000100:00100000:2.0:1784583781.610683:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035136 00000100:00100000:2.0:1784583781.610704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784583781.610711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035136:12345-0@lo:503: 00000100:00100000:2.0:1784583781.610792:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035136:12345-0@lo:503: Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.610799:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784583781.610865:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035136:0@lo:503: 00000040:00080000:1.0:1784583781.611068:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784583781.611121:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035264:0@lo:502: 00000100:00100000:1.0:1784583781.611154:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.611254:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51000 going to sleep for 11 seconds 00000100:00100000:3.0:1784583781.611400:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035264 00000100:00100000:3.0:1784583781.611405:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035264 00000100:00100000:2.0:1784583781.611708:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784583781.611722:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035264:12345-0@lo:502: 00000100:00100000:2.0:1784583781.611833:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035264:12345-0@lo:502: Request processed in 112us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583781.611840:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784583781.612170:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035264:0@lo:502: 00000040:00080000:1.0:1784583781.612724:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784583781.612758:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784583781.612774:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784583781.612786:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784583781.612799:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784583781.612810:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784583781.612822:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784583781.612834:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784583781.612845:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784583781.612859:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784583781.612874:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784583781.612900:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784583781.612915:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784583781.612928:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784583781.612940:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784583781.612953:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784583781.612978:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784583781.612991:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784583781.613002:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784583781.613013:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784583781.613025:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784583781.613037:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784583781.613048:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784583781.613064:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784583781.613076:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1784583781.613090:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1784583781.613103:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784583781.613128:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1784583781.613145:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784583781.613158:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1784583781.613171:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1784583781.613191:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1784583781.613204:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1784583781.613216:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1784583781.613226:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1784583781.613237:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1784583781.613250:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1784583781.613353:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035392:0@lo:502: 00000100:00100000:1.0:1784583781.613715:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.613788:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51000 going to sleep for 11 seconds 00000100:00100000:0.0:1784583781.613827:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035392 00000100:00100000:0.0:1784583781.613834:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035392 00000100:00100000:0.0:1784583781.613920:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784583781.613929:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035392:12345-0@lo:502: 00000100:00100000:0.0:1784583781.614056:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035392:12345-0@lo:502: Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.614063:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784583781.614132:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035392:0@lo:502: 00000040:00080000:1.0:1784583781.614181:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784583781.614190:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784583781.614783:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784583781.614800:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98b43ea619c0) 00000020:00000080:1.0:1784583781.614819:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784583781.614987:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b43e967000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784583781.614996:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b43e967000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784583781.614999:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b43e967000 3 00010000:00080000:1.0:1784583781.615028:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b30271c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784583781.623703:0:8449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1784583781.623821:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784583781.623865:0:8449:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784583781.623877:0:8449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdab2421a42e476dc 00000100:00080000:1.0:1784583781.623888:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784583781.623893:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b30271c000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583781.623928:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302424e00 x1871271599035520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784583781.623996:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599035520:0@lo:38: 00000100:00100000:2.0:1784583781.624068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583781.624166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035520 00000100:00100000:3.0:1784583781.624173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035520 00000100:00100000:3.0:1784583781.624208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784583781.624215:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599035520:12345-0@lo:38: 00010000:00080000:3.0:1784583781.624236:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1784583781.624277:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdab2421a42e476e3 00000004:00100000:3.0:1784583781.624291:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784583781.624319:0:6516:0:(import.c:65:import_set_state_nolock()) ffff98b302432000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784583781.625073:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784583781.625400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1871271599035520:12345-0@lo:38: Request processed in 1182us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583781.625432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784583781.627917:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b302424e00 x1871271599035520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583781.627930:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784583781.627939:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784583781.627947:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784583781.627952:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784583781.627955:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784583781.627961:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599035520:0@lo:38: 00000020:01000004:1.0:1784583781.628208:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784583781.628225:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98b43ea60000) 00000020:00000080:1.0:1784583781.628246:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1784583781.631955:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b43e967000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784583781.631962:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b43e967000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784583781.631966:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b43e967000 3 00010000:00080000:1.0:1784583781.631998:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b30271b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784583781.634172:0:8449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1784583781.634707:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784583781.634766:0:8449:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784583781.634780:0:8449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdab2421a42e476f1 00000100:00080000:1.0:1784583781.634790:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784583781.634796:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98b30271b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583781.634830:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302425f80 x1871271599035648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784583781.634859:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1784583781.635037:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1784583781.635196:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599035648:0@lo:38: 00000100:00100000:2.0:1784583781.635273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1784583781.635330:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784583781.635355:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784583781.635369:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583781.635390:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784583781.635451:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784583781.635453:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784583781.635458:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583781.635459:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583781.635460:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583781.635461:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583781.635462:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784583781.635464:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583781.635486:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583781.635488:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583781.635489:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784583781.635493:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784583781.635495:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784583781.635496:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784583781.635497:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583781.635498:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583781.635499:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583781.635500:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583781.635502:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784583781.635502:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583781.635503:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583781.635504:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583781.635505:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784583781.635522:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784583781.635533:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035776:0@lo:253: 00000100:00100000:2.0:1784583781.635566:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583781.635592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035776 00000100:00100000:2.0:1784583781.635598:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035776 00000100:00100000:2.0:1784583781.635702:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784583781.635709:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035776:12345-0@lo:253: 20000000:01000000:2.0:1784583781.635732:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784583781.635745:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784583781.635846:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784583781.636026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035648 00000100:00100000:1.0:1784583781.636032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035648 00000100:00100000:1.0:1784583781.636127:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784583781.636134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599035648:12345-0@lo:38: 00010000:00080000:1.0:1784583781.636155:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1784583781.636187:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdab2421a42e476f8 00000004:00100000:1.0:1784583781.636202:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784583781.636228:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98b30271d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583781.636294:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1871271599035648:12345-0@lo:38: Request processed in 159us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.636302:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784583781.636384:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b302425f80 x1871271599035648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583781.636393:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784583781.636401:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784583781.636416:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784583781.636420:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784583781.636423:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30271b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784583781.636429:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599035648:0@lo:38: 20000000:01000000:0.0:1784583781.647934:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784583781.647948:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784583781.648271:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:8420:x1871271599035776:12345-0@lo:253: Request processed in 12548us (12690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.648298:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784583781.648531:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:8420:1871271599035776:0@lo:253: 10000000:01000000:2.0:1784583781.648544:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784583781.648547:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784583781.648549:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784583781.648550:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784583781.648551:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784583781.648552:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784583781.648553:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784583781.648555:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784583781.648556:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784583781.648558:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784583781.648559:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784583781.648561:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784583781.648575:0:8420:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1784583781.649418:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784583781.649426:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784583781.649448:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649463:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e475ee expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649525:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4760a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649536:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649574:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649588:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 15 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.649608:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599035904:0@lo:104: 00000100:00100000:1.0:1784583781.649658:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583781.649705:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.649714:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 15 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.649722:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599036032:0@lo:104: 00000100:00100000:1.0:1784583781.649752:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51600 going to sleep for 11 seconds 00000100:00100000:0.0:1784583781.650345:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784583781.650368:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.650407:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599035904 00000100:00100000:0.0:1784583781.650414:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599035904 00000100:00100000:0.0:1784583781.650459:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036032 00000100:00100000:0.0:1784583781.650462:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036032 00000100:00100000:0.0:1784583781.650495:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784583781.650505:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e696050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599035904:12345-0@lo:104: 00010000:00010000:0.0:1784583781.650518:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.650572:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784583781.650578:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e696050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599035904:12345-0@lo:104: Request processed in 76us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.650585:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784583781.650752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784583781.650760:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599036032:12345-0@lo:104: 00010000:00010000:0.0:1784583781.650769:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.650806:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784583781.650812:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599036032:12345-0@lo:104: Request processed in 54us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583781.650818:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784583781.651110:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599035904:0@lo:104: 00000100:00100000:1.0:1784583781.651121:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599036032:0@lo:104: 00010000:00010000:1.0:1784583781.651193:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651528:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784583781.651535:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651559:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b400030a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583781.651563:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651570:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583781.651576:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583781.651582:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583781.651630:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651637:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583781.651657:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651664:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b400030a00/0xdab2421a42e4760a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47611 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651676:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583781.651679:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651685:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b442046e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583781.651687:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651703:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583781.651709:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583781.651713:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583781.651729:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651735:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583781.651741:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651747:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b442046e00/0xdab2421a42e475ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e475f5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.651759:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583781.651761:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583781.651763:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583781.651769:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583781.651780:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599036288:0@lo:103: 00000100:00100000:0.0:1784583781.651815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583781.651856:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599036160:0@lo:103: 00000100:00100000:1.0:1784583781.651887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583781.651934:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036288 00000100:00100000:1.0:1784583781.651940:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036160 00000100:00100000:0.0:1784583781.651941:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036288 00000100:00100000:1.0:1784583781.651948:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036160 00010000:00010000:0.0:1784583781.651964:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 17 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.651970:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 17 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.651995:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784583781.652012:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784583781.652018:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3640:x1871271599036288:12345-0@lo:103: 00000100:00100000:1.0:1784583781.652025:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3639:x1871271599036160:12345-0@lo:103: 00010000:00010000:0.0:1784583781.652030:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583781.652036:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583781.652038:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 17 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.652045:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 17 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.652050:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 17 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.652080:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 17 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.657838:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96200/0xdab2421a42e475f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e475ee expref: 17 pid: 6508 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.657861:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583781.657944:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b442046c00/0xdab2421a42e47611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4760a expref: 16 pid: 6506 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.657952:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3640:x1871271599036288:12345-0@lo:103: Request processed in 5934us (6131us total) trans 0 rc 0/0 00010000:00010000:1.0:1784583781.657966:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.657966:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1784583781.657977:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784583781.657995:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008569231s 00010000:00010000:1.0:1784583781.658000:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658007:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658014:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658021:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658027:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583781.658032:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583781.658034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599036288:0@lo:103: 00010000:00010000:1.0:1784583781.658044:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658073:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.658085:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583781.658087:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583781.658097:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583781.658105:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982a00/0xdab2421a42e476ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583781.658130:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3639:x1871271599036160:12345-0@lo:103: Request processed in 6108us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583781.658253:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784583781.658356:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599036160:0@lo:103: 00080000:10000000:2.0:1784583781.661019:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1784583781.661194:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1784583781.661366:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1784583781.661699:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1784583781.661946:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1784583781.662127:0:8420:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1784583781.666155:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784583781.690831:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784583781.690842:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784583781.690877:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784583781.690920:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784583781.690940:0:8420:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784583781.690960:0:8420:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784583781.693878:0:8420:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583781.694086:0:8420:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1784583782.576387:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583782.602357:0:8505:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583782.603160:0:8505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784583783.087614:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599036416:0@lo:41: 00000100:00100000:1.0:1784583783.087682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583783.087807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036416 00000100:00100000:3.0:1784583783.087814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036416 00000100:00100000:3.0:1784583783.087867:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583783.087876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599036416:12345-0@lo:41: 00000004:00000024:3.0:1784583783.087910:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1784583783.087961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599036416:12345-0@lo:41: Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583783.087968:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583783.088010:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599036416:0@lo:41: 00010000:00010000:2.0:1784583783.606499:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583784.622925:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583785.646186:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583786.157858:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583786.157884:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599036544:0@lo:41: 00000100:00100000:0.0:1784583786.157953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583786.158065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036544 00000100:00100000:1.0:1784583786.158073:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036544 00000100:00100000:1.0:1784583786.158126:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784583786.158136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599036544:12345-0@lo:41: 00000004:00000024:1.0:1784583786.158168:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784583786.158289:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599036544:12345-0@lo:41: Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583786.158298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784583786.158341:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599036544:0@lo:41: 00000100:00100000:3.0:1784583786.671779:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599036800:0@lo:400: 00000100:00100000:3.0:1784583786.671855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583786.671899:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599037312:0@lo:400: 00000100:00100000:3.0:1784583786.671934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583786.671959:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784583786.671965:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599036672:0@lo:400: 00000100:00100000:3.0:1784583786.672003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583786.672031:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599037184:0@lo:400: 00000100:00100000:1.0:1784583786.672037:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599036928:0@lo:400: 00000100:00100000:3.0:1784583786.672054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583786.672064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583786.672076:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599037056:0@lo:400: 00000100:00100000:3.0:1784583786.672098:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583786.672105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036928 00000100:00100000:1.0:1784583786.672111:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036928 00000100:00100000:3.0:1784583786.672120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036800 00000100:00100000:3.0:1784583786.672123:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036800 00000100:00100000:3.0:1784583786.672148:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037312 00000100:00100000:3.0:1784583786.672151:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037312 00000100:00100000:1.0:1784583786.672152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784583786.672158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599036928:12345-0@lo:400: 00000100:00100000:3.0:1784583786.672176:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037184 00000100:00100000:3.0:1784583786.672179:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037184 00000100:00100000:3.0:1784583786.672188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037056 00000100:00100000:3.0:1784583786.672190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037056 00000100:00100000:3.0:1784583786.672200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784583786.672205:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599036800:12345-0@lo:400: 00000100:00100000:1.0:1784583786.672216:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599036928:12345-0@lo:400: Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583786.672234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583786.672252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599036800:12345-0@lo:400: Request processed in 45us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583786.672258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784583786.672268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784583786.672273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599037312:12345-0@lo:400: 00000100:00100000:1.0:1784583786.672274:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599036928:0@lo:400: 00000100:00100000:3.0:1784583786.672298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599037312:12345-0@lo:400: Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583786.672304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784583786.672314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583786.672320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599037184:12345-0@lo:400: 00000100:00100000:3.0:1784583786.672344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599037184:12345-0@lo:400: Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583786.672349:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583786.672359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583786.672364:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599037056:12345-0@lo:400: 00000100:00100000:3.0:1784583786.672400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599037056:12345-0@lo:400: Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583786.672406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1784583786.672438:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8ec380 x1871271599037184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583786.672486:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599037184:0@lo:400: 00010000:00080000:3.0:1784583786.672500:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8ece00 x1871271599036800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583786.672509:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599036800:0@lo:400: 00010000:00080000:3.0:1784583786.672518:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8eea00 x1871271599037312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583786.672526:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599037312:0@lo:400: 00010000:00080000:1.0:1784583786.672536:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8ee300 x1871271599037056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583786.672545:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599037056:0@lo:400: 00000100:00100000:0.0:1784583786.672615:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599036672 00000100:00100000:0.0:1784583786.672619:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599036672 00000100:00100000:0.0:1784583786.672655:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784583786.672662:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3640:x1871271599036672:12345-0@lo:400: 00000100:00100000:0.0:1784583786.672743:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:3640:x1871271599036672:12345-0@lo:400: Request processed in 82us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583786.672750:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:0.0:1784583786.672801:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784583786.672918:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583786.672922:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583786.673772:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599036672:0@lo:400: 10000000:01000000:1.0:1784583787.182521:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784583787.182527:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b42ba2f000 from 30 10000000:01000000:1.0:1784583787.182531:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784583787.182583:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583787.182596:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583787.182607:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583787.182630:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037440:0@lo:101: 00000100:00100000:1.0:1784583787.182691:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.182737:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913540 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.182863:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037440 00000100:00100000:3.0:1784583787.182871:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037440 00000100:00100000:3.0:1784583787.182916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784583787.182924:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:6510:x1871271599037440:12345-0@lo:101: 00010000:00010000:3.0:1784583787.182936:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583787.182948:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47706 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.182970:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47706 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.182981:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47706 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.183098:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97400, rc 0) 00000100:00100000:3.0:1784583787.183200:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599037440:12345-0@lo:101: Request processed in 276us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.183208:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784583787.183301:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037440:0@lo:101: 00010000:00010000:1.0:1784583787.183318:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583787.183338:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583787.183406:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037568:0@lo:501: 00000100:00100000:1.0:1784583787.183430:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.183451:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913540 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.184032:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037568 00000100:00100000:3.0:1784583787.184039:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037568 00000100:00100000:3.0:1784583787.184067:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784583787.184074:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599037568:12345-0@lo:501: 00000100:00100000:3.0:1784583787.184356:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599037568:12345-0@lo:501: Request processed in 281us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.184364:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784583787.184430:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037568:0@lo:501: 00000100:00100000:1.0:1784583787.184461:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037696:0@lo:503: 00000100:00100000:1.0:1784583787.184525:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.184549:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913540 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.185235:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037696 00000100:00100000:3.0:1784583787.185242:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037696 00000100:00100000:3.0:1784583787.185279:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784583787.185286:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599037696:12345-0@lo:503: 00000100:00100000:3.0:1784583787.185378:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599037696:12345-0@lo:503: Request processed in 92us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.185386:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784583787.185508:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599037696:0@lo:503: 00000100:00100000:1.0:1784583787.186743:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8782:1871271599037824:0@lo:502: 00000100:00100000:1.0:1784583787.186810:0:8782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.186839:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913780 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.186970:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037824 00000100:00100000:3.0:1784583787.186977:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037824 00000100:00100000:3.0:1784583787.187082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784583787.187091:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8782:x1871271599037824:12345-0@lo:502: 00000100:00100000:3.0:1784583787.187309:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8782:x1871271599037824:12345-0@lo:502: Request processed in 218us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.187316:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784583787.187496:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8782:1871271599037824:0@lo:502: 00000100:00100000:1.0:1784583787.187545:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8782:1871271599037952:0@lo:502: 00000100:00100000:1.0:1784583787.189094:0:8782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.189137:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41727dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583787.189261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599037952 00000100:00100000:0.0:1784583787.189269:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599037952 00000100:00100000:0.0:1784583787.189321:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784583787.189331:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8782:x1871271599037952:12345-0@lo:502: 00000100:00100000:0.0:1784583787.189444:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:8782:x1871271599037952:12345-0@lo:502: Request processed in 115us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583787.189452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784583787.189803:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8782:1871271599037952:0@lo:502: 00000040:00080000:1.0:1784583787.189836:0:8782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784583787.190884:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784583787.190909:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784583787.190919:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.190930:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583787.190939:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784583787.190941:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b42ba2f000 from 5 10000000:01000000:2.0:1784583787.190944:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583787.190978:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.191057:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.191067:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583787.191087:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038080:0@lo:101: 00000100:00100000:2.0:1784583787.191194:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.191236:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4172596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583787.191290:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038080 00000100:00100000:0.0:1784583787.191296:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038080 00000100:00100000:0.0:1784583787.191336:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784583787.191344:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599038080:12345-0@lo:101: 00010000:00010000:0.0:1784583787.191356:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583787.191370:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47714 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583787.191392:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47714 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583787.191403:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47714 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583787.191426:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216b800, rc 0) 00000100:00100000:0.0:1784583787.191492:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599038080:12345-0@lo:101: Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583787.191499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784583787.191890:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038080:0@lo:101: 00010000:00010000:2.0:1784583787.191904:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.191924:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583787.191969:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038208:0@lo:256: 00000100:00100000:2.0:1784583787.192692:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.192724:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4172596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583787.192778:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038208 00000100:00100000:1.0:1784583787.192785:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038208 00000100:00100000:1.0:1784583787.192844:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784583787.192852:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599038208:12345-0@lo:256: 20000000:01000000:1.0:1784583787.192879:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784583787.192894:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784583787.192898:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784583787.192978:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599038208:12345-0@lo:256: Request processed in 126us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.193179:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038208:0@lo:256: 10000000:01000000:2.0:1784583787.193239:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784583787.193247:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193256:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583787.193265:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784583787.193267:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1784583787.193269:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784583787.193292:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193300:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193308:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583787.193322:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038336:0@lo:101: 00000100:00100000:2.0:1784583787.193360:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.193386:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4172596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583787.193399:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038336 00000100:00100000:2.0:1784583787.193403:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038336 00000100:00100000:2.0:1784583787.193422:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583787.193428:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599038336:12345-0@lo:101: 00010000:00010000:2.0:1784583787.193435:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583787.193446:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47722 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193463:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47722 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193544:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47722 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.193552:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a200, rc 0) 00000100:00100000:1.0:1784583787.194080:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784583787.194944:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038336:0@lo:101: 00010000:00010000:0.0:1784583787.194965:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583787.194976:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583787.195046:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038464:0@lo:501: 00000100:00100000:0.0:1784583787.195097:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583787.195132:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32480 going to sleep for 11 seconds 00000100:00100000:1.0:1784583787.195303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038464 00000100:00100000:1.0:1784583787.195309:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038464 00000100:00100000:1.0:1784583787.195347:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784583787.195355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599038464:12345-0@lo:501: 00000100:00100000:1.0:1784583787.195493:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599038464:12345-0@lo:501: Request processed in 138us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.195501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784583787.195536:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038464:0@lo:501: 00000100:00100000:1.0:1784583787.195565:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038592:0@lo:503: 00000100:00100000:1.0:1784583787.195620:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.195634:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583787.195645:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038592 00000100:00100000:1.0:1784583787.195648:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038592 00000100:00100000:1.0:1784583787.195663:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784583787.195668:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599038592:12345-0@lo:503: 00000100:00100000:1.0:1784583787.195737:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599038592:12345-0@lo:503: Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.195744:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784583787.195777:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599038592:0@lo:503: 00000100:00100000:1.0:1784583787.195937:0:8783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8783:1871271599038720:0@lo:502: 00000100:00100000:1.0:1784583787.195972:0:8783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.195988:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038720 00000100:00100000:1.0:1784583787.195992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038720 00000100:00100000:1.0:1784583787.196008:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784583787.196013:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8783:x1871271599038720:12345-0@lo:502: 00000100:00100000:1.0:1784583787.196081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8783:x1871271599038720:12345-0@lo:502: Request processed in 67us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.196272:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784583787.196305:0:8783:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784583787.196318:0:8783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8783:1871271599038720:0@lo:502: 00000020:01000000:1.0:1784583787.196338:0:8783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784583787.196345:0:8783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784583787.196353:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583787.196355:0:8783:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784583787.196360:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784583787.196364:0:8783:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1784583787.196385:0:8783:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784583787.196387:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784583787.196400:0:8783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98b43ea63380) 00000020:00000080:1.0:1784583787.196422:0:8783:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784583787.196427:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784583787.196612:0:8783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1784583787.196619:0:8783:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784583787.196626:0:8783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47737 00010000:00080000:1.0:1784583787.196656:0:8783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302458000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784583787.196869:0:8783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1784583787.197088:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599038336:12345-0@lo:101: Request processed in 1140us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.197096:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000040:01000000:2.0:1784583787.215909:0:8783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784583787.215933:0:8783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1784583787.216267:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583787.216505:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583787.216628:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784583787.216713:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784583787.217772:0:8789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583787.217778:0:8789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784583787.229559:0:8783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784583787.229575:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784583787.229619:0:8783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784583787.229641:0:8783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4773e 00000100:00080000:2.0:1784583787.229663:0:8783:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784583787.229669:0:8783:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b302458000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583787.229705:0:8783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b404957100 x1871271599038848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784583787.229742:0:8783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1784583787.229782:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599038848:0@lo:8: 00000100:00100000:3.0:1784583787.229853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.230022:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038848 00000100:00100000:3.0:1784583787.230029:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038848 00000100:00100000:3.0:1784583787.230059:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583787.230065:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599038848:12345-0@lo:8: 00010000:00080000:3.0:1784583787.230104:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:3.0:1784583787.230130:0:8426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e47745 00002000:00100000:3.0:1784583787.230159:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98b302437800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784583787.230164:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1784583787.230168:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1784583787.230183:0:8783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583787.230189:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583787.230191:0:8783:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784583787.230195:0:8783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583787.230200:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583787.230202:0:8783:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784583787.230205:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784583787.230206:0:8783:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784583787.230241:0:8783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8783:1871271599039744:0@lo:502: 00002000:00100000:3.0:1784583787.230243:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784583787.230296:0:8783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.230320:0:8783:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259240 going to sleep for 11 seconds 00002000:00080000:3.0:1784583787.230452:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1784583787.230507:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b302435000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784583787.230554:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599038848:12345-0@lo:8: Request processed in 488us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.230563:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784583787.230595:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404957100 x1871271599038848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784583797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.230601:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599038976:0@lo:400: 00000100:00100000:2.0:1784583787.230609:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784583787.230617:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784583787.230625:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784583787.230629:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784583787.230632:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302458000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583787.230638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784583787.230648:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784583787.230657:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599038848:0@lo:8: 00000100:00100000:3.0:1784583787.230663:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599039488:0@lo:400: 00000100:00100000:3.0:1784583787.230687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.230699:0:8790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599039872:0@lo:700: 00000100:00100000:3.0:1784583787.230710:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784583787.230719:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599039104:0@lo:400: 00000100:00100000:2.0:1784583787.230733:0:8790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.230755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.230755:0:8790:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4172599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.230778:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599039616:0@lo:400: 00000100:00100000:3.0:1784583787.230799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.230826:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599039232:0@lo:400: 00000100:00100000:3.0:1784583787.230847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.230860:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583787.230865:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599039360:0@lo:400: 00000100:00100000:3.0:1784583787.230885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.230927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599038976 00000100:00100000:3.0:1784583787.230932:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599038976 00000100:00100000:3.0:1784583787.230954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039488 00000100:00100000:3.0:1784583787.230958:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039488 00000100:00100000:3.0:1784583787.230970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039616 00000100:00100000:3.0:1784583787.230973:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039616 00000100:00100000:3.0:1784583787.231005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039232 00000100:00100000:3.0:1784583787.231009:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039232 00000100:00100000:3.0:1784583787.231022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583787.231028:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599038976:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599038976:12345-0@lo:400: Request processed in 38us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583787.231086:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583787.231093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599039488:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599039488:12345-0@lo:400: Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583787.231135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784583787.231141:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599039616:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599039616:12345-0@lo:400: Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231174:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784583787.231185:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784583787.231190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599039232:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599039232:12345-0@lo:400: Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231244:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784583787.231278:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039872 00000100:00100000:3.0:1784583787.231282:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039872 00000100:00100000:3.0:1784583787.231313:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784583787.231321:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8790:x1871271599039872:12345-0@lo:700: 00000100:00100000:3.0:1784583787.231350:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1871271599040000:0@lo:700: 00000100:00100000:3.0:1784583787.231373:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.231389:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164600 going to sleep for 11 seconds 00010000:00080000:2.0:1784583787.231398:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b100 x1871271599039232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.231404:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039104 00000100:00100000:3.0:1784583787.231410:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039104 00000100:00100000:2.0:1784583787.231415:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599039232:0@lo:400: 00000100:00100000:3.0:1784583787.231434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039360 00000100:00100000:3.0:1784583787.231438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039360 00000100:00100000:3.0:1784583787.231453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583787.231459:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599039104:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231526:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599039104:12345-0@lo:400: Request processed in 67us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583787.231544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583787.231549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599039360:12345-0@lo:400: 00000100:00100000:3.0:1784583787.231579:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599039360:12345-0@lo:400: Request processed in 30us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.231584:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1784583787.231605:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583787.231618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040000 00000100:00100000:3.0:1784583787.231621:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040000 00000100:00100000:3.0:1784583787.231642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784583787.231648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1871271599040000:12345-0@lo:700: 00000100:00100000:3.0:1784583787.231745:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599039360:0@lo:400: 00000100:00100000:3.0:1784583787.231777:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599039104:0@lo:400: 00010000:00080000:3.0:1784583787.231787:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b800 x1871271599039616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.231796:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599039616:0@lo:400: 00010000:00080000:3.0:1784583787.231805:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef18700 x1871271599038976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.231812:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599038976:0@lo:400: 00010000:00080000:3.0:1784583787.231821:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1ad80 x1871271599039488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.231828:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599039488:0@lo:400: 00000100:00100000:2.0:1784583787.235090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599039744 00000100:00100000:2.0:1784583787.235104:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599039744 00000100:00100000:2.0:1784583787.235165:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784583787.235174:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8783:x1871271599039744:12345-0@lo:502: 00000100:00100000:2.0:1784583787.235344:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:8783:x1871271599039744:12345-0@lo:502: Request processed in 171us (5049us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.235352:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784583787.235412:0:8783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8783:1871271599039744:0@lo:502: 00000020:01000000:2.0:1784583787.235445:0:8783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583787.235451:0:8783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583787.235453:0:8783:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784583787.235457:0:8783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1784583787.238282:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1784583787.238323:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784583787.238333:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.238344:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583787.238355:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784583787.238358:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b418942800 from 30 10000000:01000000:2.0:1784583787.238361:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784583787.238394:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.238415:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583787.238426:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784583787.238611:0:8789:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784583787.238683:0:8789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 230424214164ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784583787.238691:0:8789:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784583787.240032:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040128:0@lo:101: 40000000:02000000:0.0:1784583787.241018:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1784583787.241078:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.241120:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040128 00000100:00100000:3.0:1784583787.241130:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040128 00000100:00100000:2.0:1784583787.241185:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259240 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.241253:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784583787.241264:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599040128:12345-0@lo:101: 00010000:00010000:3.0:1784583787.241280:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583787.241297:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4774c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.241320:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4774c expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.241330:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4774c expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.241338:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97800, rc 0) 00000100:00100000:3.0:1784583787.241392:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040128:12345-0@lo:101: Request processed in 130us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.241483:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784583787.241531:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040128:0@lo:101: 00010000:00010000:3.0:1784583787.241547:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.241635:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.241700:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040256:0@lo:501: 00000100:00100000:3.0:1784583787.241726:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.241745:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.241757:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040256 00000100:00100000:3.0:1784583787.241760:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040256 00000100:00100000:3.0:1784583787.241783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784583787.241789:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040256:12345-0@lo:501: 00000100:00100000:3.0:1784583787.244527:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040256:12345-0@lo:501: Request processed in 2730us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.244540:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784583787.244619:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040256:0@lo:501: 00000100:00100000:3.0:1784583787.244672:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040384:0@lo:503: 00000100:00100000:3.0:1784583787.245438:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.245498:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.245520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040384 00000100:00100000:3.0:1784583787.245526:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040384 00000100:00100000:3.0:1784583787.245567:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784583787.245632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040384:12345-0@lo:503: 00000100:00100000:3.0:1784583787.246103:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040384:12345-0@lo:503: Request processed in 472us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.246111:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784583787.246160:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040384:0@lo:503: 00000100:00100000:3.0:1784583787.246348:0:8793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8793:1871271599040512:0@lo:502: 00000100:00100000:3.0:1784583787.246383:0:8793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.246405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040512 00000100:00100000:3.0:1784583787.246408:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040512 00000100:00100000:3.0:1784583787.246431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784583787.246437:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8793:x1871271599040512:12345-0@lo:502: 00000100:00100000:3.0:1784583787.246535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8793:x1871271599040512:12345-0@lo:502: Request processed in 97us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.246542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784583787.246643:0:8793:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.246657:0:8793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8793:1871271599040512:0@lo:502: 00000100:00100000:3.0:1784583787.247090:0:8793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8793:1871271599040640:0@lo:502: 00000100:00100000:3.0:1784583787.247127:0:8793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.247151:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040640 00000100:00100000:3.0:1784583787.247155:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040640 00000100:00100000:3.0:1784583787.247178:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784583787.247184:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8793:x1871271599040640:12345-0@lo:502: 00000100:00100000:3.0:1784583787.247257:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:8793:x1871271599040640:12345-0@lo:502: Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.247264:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784583787.247304:0:8793:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.247317:0:8793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8793:1871271599040640:0@lo:502: 00000040:00080000:3.0:1784583787.247336:0:8793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784583787.247390:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784583787.247407:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784583787.247416:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.247427:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583787.247436:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784583787.247439:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b418942800 from 5 10000000:01000000:3.0:1784583787.247442:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784583787.247463:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.247629:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.247641:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.247654:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040768:0@lo:101: 00000100:00100000:3.0:1784583787.247680:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.248069:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.248088:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040768 00000100:00100000:3.0:1784583787.248093:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040768 00000100:00100000:3.0:1784583787.248122:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784583787.248129:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599040768:12345-0@lo:101: 00010000:00010000:3.0:1784583787.248146:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583787.248158:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4775a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.248179:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4775a expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.248190:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4775a expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.248199:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583787.248243:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599040768:12345-0@lo:101: Request processed in 114us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.248250:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784583787.248286:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040768:0@lo:101: 00010000:00010000:3.0:1784583787.248298:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.248307:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.248349:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040896:0@lo:256: 00000100:00100000:3.0:1784583787.248378:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.248391:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.248402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599040896 00000100:00100000:3.0:1784583787.248405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599040896 00000100:00100000:3.0:1784583787.248426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784583787.248432:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599040896:12345-0@lo:256: 20000000:01000000:3.0:1784583787.248451:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784583787.248487:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784583787.248490:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784583787.248561:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599040896:12345-0@lo:256: Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.248567:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784583787.249096:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599040896:0@lo:256: 10000000:01000000:3.0:1784583787.249135:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784583787.249142:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249149:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583787.249157:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784583787.249159:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784583787.249162:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784583787.249180:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249187:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249195:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.249208:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041024:0@lo:101: 00000100:00100000:3.0:1784583787.249247:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.249270:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.249288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041024 00000100:00100000:3.0:1784583787.249292:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041024 00000100:00100000:3.0:1784583787.249317:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784583787.249324:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599041024:12345-0@lo:101: 00010000:00010000:3.0:1784583787.249331:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583787.249342:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47768 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249356:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47768 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249364:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47768 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249371:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97e00, rc 0) 00000100:00100000:3.0:1784583787.249399:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041024:12345-0@lo:101: Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.249405:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784583787.249434:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041024:0@lo:101: 00010000:00010000:3.0:1784583787.249445:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.249453:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.249522:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041152:0@lo:501: 00000100:00100000:3.0:1784583787.249548:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.249566:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.249638:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041152 00000100:00100000:3.0:1784583787.249648:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041152 00000100:00100000:3.0:1784583787.249671:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784583787.249677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041152:12345-0@lo:501: 00000100:00100000:3.0:1784583787.250152:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041152:12345-0@lo:501: Request processed in 474us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.250160:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784583787.250196:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041152:0@lo:501: 00000100:00100000:3.0:1784583787.250237:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041280:0@lo:503: 00000100:00100000:3.0:1784583787.250278:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.250294:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.250306:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041280 00000100:00100000:3.0:1784583787.250310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041280 00000100:00100000:3.0:1784583787.250332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784583787.250339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041280:12345-0@lo:503: 00000100:00100000:3.0:1784583787.250417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041280:12345-0@lo:503: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.250423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784583787.250463:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041280:0@lo:503: 00000100:00100000:3.0:1784583787.252068:0:8794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8794:1871271599041408:0@lo:502: 00000100:00100000:3.0:1784583787.252126:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.252155:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041408 00000100:00100000:3.0:1784583787.252161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041408 00000100:00100000:3.0:1784583787.252194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784583787.252201:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:8794:x1871271599041408:12345-0@lo:502: 00000100:00100000:3.0:1784583787.252304:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:8794:x1871271599041408:12345-0@lo:502: Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.252327:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784583787.252371:0:8794:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.252388:0:8794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8794:1871271599041408:0@lo:502: 00000020:01000000:3.0:1784583787.252412:0:8794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784583787.252420:0:8794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784583787.252426:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583787.252429:0:8794:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784583787.252434:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784583787.252437:0:8794:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:3.0:1784583787.252458:0:8794:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784583787.252460:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784583787.252494:0:8794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98b3024799c0) 00000020:00000080:3.0:1784583787.252526:0:8794:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1784583787.252534:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784583787.252606:0:8794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784583787.252611:0:8794:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784583787.252617:0:8794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e4777d 00010000:00080000:3.0:1784583787.252644:0:8794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302b0d000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784583787.254153:0:8794:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:2.0:1784583787.257932:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1784583787.267337:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1871271599040000:12345-0@lo:700: Request processed in 35681us (35955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583787.267356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:01000000:3.0:1784583787.268497:0:8794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784583787.268519:0:8794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784583787.268713:0:8794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784583787.268962:0:8794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784583787.269055:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1784583787.269163:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00080000:2.0:1784583787.274246:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b480 x1871271599040000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.274264:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1871271599040000:0@lo:700: 40000000:02000000:2.0:1784583787.274279:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:00080000:1.0:1784583787.282526:0:8798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583787.282536:0:8798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784583787.293028:0:8794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784583787.293042:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784583787.293094:0:8794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784583787.293121:0:8794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e47784 00000100:00080000:0.0:1784583787.293131:0:8794:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784583787.293144:0:8794:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b302b0d000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784583787.293192:0:8794:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b40a51ce00 x1871271599041536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784583787.293215:0:8794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784583787.293295:0:8794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583787.293300:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583787.293302:0:8794:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784583787.293306:0:8794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583787.293310:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583787.293311:0:8794:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784583787.293314:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784583787.293316:0:8794:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784583787.293342:0:8794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8794:1871271599041664:0@lo:502: 00000100:00100000:0.0:1784583787.293423:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583787.293465:0:8794:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.296679:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041664 00000100:00100000:3.0:1784583787.296693:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041664 00000100:00100000:3.0:1784583787.296741:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784583787.296822:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599041536:0@lo:8: 00000001:00100000:1.0:1784583787.296864:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1784583787.296893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.296915:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:8794:x1871271599041664:12345-0@lo:502: 00000100:00100000:3.0:1784583787.297065:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:8794:x1871271599041664:12345-0@lo:502: Request processed in 153us (3640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.297073:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784583787.297183:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041536 00000100:00100000:1.0:1784583787.297189:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041536 00000100:00100000:1.0:1784583787.297214:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583787.297230:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599041536:12345-0@lo:8: 00010000:00080000:1.0:1784583787.297256:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1784583787.297285:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e4778b 00002000:00100000:1.0:1784583787.297298:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98b30245f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784583787.297302:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784583787.297305:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784583787.297379:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784583787.297401:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98b30245e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583787.297443:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599041536:12345-0@lo:8: Request processed in 222us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.297452:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784583787.297687:0:8794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:8794:1871271599041664:0@lo:502: 00000020:01000000:3.0:1784583787.297716:0:8794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583787.297722:0:8794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583787.297724:0:8794:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784583787.297728:0:8794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1784583787.297898:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1784583787.297917:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784583787.297926:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.297937:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583787.297947:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784583787.297949:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b4331acd40 from 1 10000000:01000000:3.0:1784583787.297952:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784583787.297979:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.297986:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.297995:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583787.298011:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041792:0@lo:101: 00000100:00100000:3.0:1784583787.298052:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.298076:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.298091:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041792 00000100:00100000:2.0:1784583787.298332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599039872:12345-0@lo:700: Request processed in 67011us (67598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.298345:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784583787.298380:0:8790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404957100 x1871271599039872/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.298391:0:8790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599039872:0@lo:700: 00000100:00100000:3.0:1784583787.298952:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041792 00000100:00100000:3.0:1784583787.299030:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784583787.299038:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599041792:12345-0@lo:101: 00010000:00010000:3.0:1784583787.299050:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583787.299062:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47792 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.299083:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.299094:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583787.299113:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583787.299155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599041792:12345-0@lo:101: Request processed in 117us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583787.299160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784583787.299271:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041792:0@lo:101: 00010000:00010000:1.0:1784583787.299285:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583787.299294:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583787.299369:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041920:0@lo:501: 00000100:00100000:1.0:1784583787.299407:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.302576:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583787.302638:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599041920 00000100:00100000:2.0:1784583787.302648:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599041920 00000100:00100000:2.0:1784583787.303294:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784583787.303305:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599041920:12345-0@lo:501: 00000100:00100000:2.0:1784583787.303426:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599041920:12345-0@lo:501: Request processed in 124us (4018us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784583787.303440:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784583787.305432:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599041920:0@lo:501: 10000000:01000000:1.0:1784583787.305497:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784583787.305507:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583787.305516:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784583787.306670:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40a51ce00 x1871271599041536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784583797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583787.306683:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784583787.306694:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784583787.306702:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784583787.306708:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784583787.306711:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784583787.306729:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784583787.306736:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599041536:0@lo:8: 00000004:00080000:0.0:1784583787.306766:0:8798:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784583787.306841:0:8798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 230492372245ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784583787.306854:0:8798:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784583787.324357:0:8790:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:2.0:1784583787.324392:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784583787.324393:0:8790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042176:0@lo:7: 00000100:00100000:1.0:1784583787.324461:0:8790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.324519:0:8790:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40000 going to sleep for 11 seconds 00000004:00080000:0.0:1784583787.325442:0:8799:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784583787.325465:0:8799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599042432:0@lo:7: 00000100:00100000:0.0:1784583787.325546:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583787.325571:0:8799:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784583787.325595:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042176 00000100:00100000:0.0:1784583787.325601:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042176 00000100:00100000:0.0:1784583787.325644:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042432 00000100:00100000:0.0:1784583787.325647:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042432 00000100:00100000:0.0:1784583787.325677:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583787.325685:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599042176:12345-0@lo:7: 00000100:00100000:2.0:1784583787.327932:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599042304:0@lo:13: 00000100:00100000:2.0:1784583787.328015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.328060:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784583787.328067:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599042048:0@lo:13: 00000100:00100000:2.0:1784583787.328088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784583787.328339:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583787.329374:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042304 00000100:00100000:1.0:1784583787.329384:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042304 00000100:00100000:1.0:1784583787.329421:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042048 00000100:00100000:1.0:1784583787.329424:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042048 00000100:00100000:1.0:1784583787.329444:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784583787.329455:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1871271599042304:12345-0@lo:13: 00002000:00000024:1.0:1784583787.329500:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:1.0:1784583787.329593:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1871271599042304:12345-0@lo:13: Request processed in 140us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.329600:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784583787.329616:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40a51ce00 x1871271599042304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583787.329623:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784583787.329635:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599042048:12345-0@lo:13: 00000100:00100000:3.0:1784583787.329644:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599042304:0@lo:13: 00002000:00000024:1.0:1784583787.329646:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00010000:00080000:3.0:1784583787.329740:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426a00 x1871271599042048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.329764:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599042048:0@lo:13: 00000100:00100000:1.0:1784583787.329813:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599042048:12345-0@lo:13: Request processed in 66us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.329832:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1784583787.340083:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1784583787.340092:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784583787.340183:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599042176:12345-0@lo:7: Request processed in 14494us (15717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583787.340193:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:02000400:1.0:1784583787.340633:0:8803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00080000:2.0:1784583787.341346:0:8790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302425c00 x1871271599042176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.341363:0:8790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042176:0@lo:7: 00000004:00080000:2.0:1784583787.341377:0:8790:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784583787.341417:0:8790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042560:0@lo:5: 00000100:00100000:2.0:1784583787.341459:0:8790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.341517:0:8790:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259840 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.341578:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042560 00000100:00100000:3.0:1784583787.341585:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042560 00000100:00100000:3.0:1784583787.341635:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784583787.341644:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8799:x1871271599042432:12345-0@lo:7: 00002000:00080000:2.0:1784583787.354547:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784583787.354555:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784583787.354642:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8799:x1871271599042432:12345-0@lo:7: Request processed in 12995us (29093us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.354656:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784583787.354682:0:8799:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40a51c700 x1871271599042432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.354690:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784583787.354704:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599042560:12345-0@lo:5: 00000100:00100000:0.0:1784583787.354706:0:8799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599042432:0@lo:7: 00000004:00080000:0.0:1784583787.354722:0:8799:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00002000:00080000:2.0:1784583787.354734:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1784583787.354759:0:8799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599042688:0@lo:5: 00000100:00100000:2.0:1784583787.354783:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599042560:12345-0@lo:5: Request processed in 81us (13321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583787.354790:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784583787.354881:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583787.354913:0:8799:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583787.355588:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042688 00000100:00100000:3.0:1784583787.355597:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042688 00000100:00100000:3.0:1784583787.355644:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784583787.355654:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8799:x1871271599042688:12345-0@lo:5: 00002000:00080000:3.0:1784583787.355673:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784583787.355676:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1784583787.357643:0:8790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404957800 x1871271599042560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583787.357661:0:8790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042560:0@lo:5: 00000004:00080000:1.0:1784583787.357676:0:8790:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784583787.357717:0:8790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042816:0@lo:5: 00000100:00100000:1.0:1784583787.357767:0:8790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583787.357823:0:8790:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40600 going to sleep for 11 seconds 00000100:00100000:0.0:1784583787.360006:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784583787.360020:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784583787.362797:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042816 00000100:00100000:0.0:1784583787.362811:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042816 00000100:00100000:0.0:1784583787.362939:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784583787.362955:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8790:x1871271599042816:12345-0@lo:5: 00002000:00080000:0.0:1784583787.362994:0:8805:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1784583787.365158:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8790:x1871271599042816:12345-0@lo:5: Request processed in 2200us (7384us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784583787.365169:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784583787.365405:0:8790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426300 x1871271599042816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.365429:0:8790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8790:1871271599042816:0@lo:5: 00000004:00080000:2.0:1784583787.365444:0:8790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1784583787.367288:0:8790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8790:1871271599042944:0@lo:900: 00000100:00100000:2.0:1784583787.367350:0:8790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.367391:0:8790:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583787.367432:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599042944 00000100:00100000:0.0:1784583787.367441:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599042944 00000100:00100000:0.0:1784583787.367501:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784583787.367511:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8790:x1871271599042944:12345-0@lo:900: 00000100:00100000:0.0:1784583787.367904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8790:x1871271599042944:12345-0@lo:900: Request processed in 391us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583787.367914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784583787.367932:0:8790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404954e00 x1871271599042944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.367947:0:8790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8790:1871271599042944:0@lo:900: 00000001:00080000:1.0:1784583787.369954:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1784583787.369973:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784583787.370891:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8799:x1871271599042688:12345-0@lo:5: Request processed in 15234us (16005us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784583787.370903:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784583787.370928:0:8799:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302b47800 x1871271599042688/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583787.370941:0:8799:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784583787.370948:0:8799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599042688:0@lo:5: 00000004:00080000:2.0:1784583787.370963:0:8799:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784583787.371008:0:8799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599043072:0@lo:700: 00000100:00100000:2.0:1784583787.371043:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583787.371073:0:8799:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583787.371523:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043072 00000100:00100000:2.0:1784583787.371530:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043072 00000100:00100000:2.0:1784583787.371569:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784583787.371577:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8799:x1871271599043072:12345-0@lo:700: 00000001:00080000:3.0:1784583787.399419:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1784583787.399798:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8799:x1871271599043072:12345-0@lo:700: Request processed in 28207us (28740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583787.399817:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784583787.400008:0:8799:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404954e00 x1871271599043072/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583787.400024:0:8799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599043072:0@lo:700: 00000004:02000040:3.0:1784583787.403402:0:8799:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1784583787.415064:0:8799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599043200:0@lo:5: 00000100:00100000:3.0:1784583787.415797:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583787.415851:0:8799:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583787.415871:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043200 00000100:00100000:2.0:1784583787.415879:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043200 00000100:00100000:2.0:1784583787.415928:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784583787.415937:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8799:x1871271599043200:12345-0@lo:5: 00002000:00080000:2.0:1784583787.427738:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1784583787.427759:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1784583787.440305:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8799:x1871271599043200:12345-0@lo:5: Request processed in 24357us (24497us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784583787.440321:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784583787.441284:0:8799:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef18700 x1871271599043200/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583787.441304:0:8799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8799:1871271599043200:0@lo:5: 00000004:00080000:0.0:1784583787.441322:0:8799:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1784583787.693885:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583788.206633:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599043328:0@lo:41: 00000100:00100000:0.0:1784583788.206694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583788.206790:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043328 00000100:00100000:3.0:1784583788.206798:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043328 00000100:00100000:3.0:1784583788.206846:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583788.206921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599043328:12345-0@lo:41: 00000004:00000024:3.0:1784583788.206956:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784583788.207003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599043328:12345-0@lo:41: Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583788.207017:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583788.207058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599043328:0@lo:41: 00000020:00000004:2.0:1784583788.227149:0:8856:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583788.227373:0:8856:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784583788.727346:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784583788.904996:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1784583789.745196:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583790.766972:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784583790.773012:0:8957:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583790.773240:0:8957:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784583791.286335:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599043456:0@lo:41: 00000100:00100000:3.0:1784583791.286401:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583791.286501:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043456 00000100:00100000:3.0:1784583791.286509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043456 00000100:00100000:3.0:1784583791.286553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784583791.286561:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599043456:12345-0@lo:41: 00000004:00000024:3.0:1784583791.286594:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784583791.286636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599043456:12345-0@lo:41: Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583791.286643:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784583791.286840:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599043456:0@lo:41: 00000020:00000004:0.0:1784583791.540870:0:9006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583791.540881:0:9006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1784583791.789932:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583792.301764:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583792.301988:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599043712:0@lo:400: 00000100:00100000:0.0:1784583792.302060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583792.302115:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599043584:0@lo:400: 00000100:00100000:1.0:1784583792.302124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043712 00000100:00100000:1.0:1784583792.302131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043712 00000100:00100000:0.0:1784583792.302139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583792.302173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784583792.302182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599043712:12345-0@lo:400: 00000100:00100000:1.0:1784583792.302247:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599043712:12345-0@lo:400: Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583792.302255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784583792.302305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043584 00000100:00100000:2.0:1784583792.302310:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043584 00000100:00100000:2.0:1784583792.302344:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784583792.302350:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599043584:12345-0@lo:400: 00000100:00100000:2.0:1784583792.302382:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599043584:12345-0@lo:400: Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583792.302388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1784583792.302496:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1ad80 x1871271599043712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583792.302526:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599043712:0@lo:400: 00000100:00100000:0.0:1784583792.302538:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599043584:0@lo:400: 00000100:00100000:1.0:1784583792.302752:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583792.302820:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784583792.302827:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599043840:0@lo:400: 00000100:00100000:0.0:1784583792.302827:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599043968:0@lo:400: 00000100:00100000:0.0:1784583792.302861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583792.302864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583792.302923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043968 00000100:00100000:2.0:1784583792.302928:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043968 00000100:00100000:2.0:1784583792.302959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784583792.302965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599043968:12345-0@lo:400: 00000100:00100000:2.0:1784583792.303006:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599043968:12345-0@lo:400: Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583792.303013:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1784583792.303070:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b100 x1871271599043968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583792.303080:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599043968:0@lo:400: 00000100:00100000:0.0:1784583792.303092:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599044352:0@lo:400: 00000100:00100000:0.0:1784583792.303116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583792.303125:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599043840 00000100:00100000:3.0:1784583792.303129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599043840 00000100:00100000:0.0:1784583792.303130:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583792.303134:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599044480:0@lo:400: 00000100:00100000:3.0:1784583792.303153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784583792.303158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583792.303159:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599043840:12345-0@lo:400: 00000100:00100000:3.0:1784583792.303212:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599043840:12345-0@lo:400: Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583792.303215:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599044096:0@lo:400: 00000100:00100000:3.0:1784583792.303219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784583792.303240:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599044224:0@lo:400: 00000100:00100000:2.0:1784583792.303243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583792.303260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583792.303308:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599044608:0@lo:400: 00000100:00100000:1.0:1784583792.303311:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044480 00000100:00100000:1.0:1784583792.303315:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044480 00000100:00100000:2.0:1784583792.303331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583792.303353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044096 00000100:00100000:3.0:1784583792.303354:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044352 00000100:00100000:0.0:1784583792.303356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044096 00000100:00100000:3.0:1784583792.303357:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044352 00000100:00100000:0.0:1784583792.303379:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784583792.303384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599044096:12345-0@lo:400: 00000100:00100000:0.0:1784583792.303418:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599044096:12345-0@lo:400: Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583792.303424:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784583792.303515:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599044096:0@lo:400: 00000100:00100000:1.0:1784583792.303799:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044608 00000100:00100000:1.0:1784583792.303804:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044608 00000100:00100000:0.0:1784583792.303838:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784583792.303845:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599044480:12345-0@lo:400: 00000100:00100000:0.0:1784583792.303892:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599044480:12345-0@lo:400: Request processed in 47us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583792.303907:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784583792.303921:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784583792.303927:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599044608:12345-0@lo:400: 00000100:00100000:0.0:1784583792.303960:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599044608:12345-0@lo:400: Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583792.303967:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784583792.303993:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43eadfb80 x1871271599044608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583792.304002:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1784583792.304010:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599044608:0@lo:400: 00010000:00080000:2.0:1784583792.304074:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40a51ce00 x1871271599044480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583792.304082:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784583792.304091:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599044480:0@lo:400: 00000100:00080000:1.0:1784583792.304201:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583792.304207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583792.304225:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599043840:0@lo:400: 00000100:00100000:1.0:1784583792.305035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044224 00000100:00100000:1.0:1784583792.305041:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044224 00000100:00100000:3.0:1784583792.305123:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583792.305132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599044352:12345-0@lo:400: 00000100:00100000:3.0:1784583792.305202:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599044352:12345-0@lo:400: Request processed in 71us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583792.305209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784583792.305267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784583792.305274:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599044224:12345-0@lo:400: 00000100:00100000:1.0:1784583792.305313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599044224:12345-0@lo:400: Request processed in 40us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583792.305320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1784583792.305353:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1ad80 x1871271599044224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583792.305364:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599044224:0@lo:400: 00010000:00080000:2.0:1784583792.305444:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40a51c700 x1871271599044352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583792.305454:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599044352:0@lo:400: 00000100:00080000:0.0:1784583792.305563:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583792.813740:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599044736:0@lo:13: 00000100:00100000:3.0:1784583792.813812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784583792.813914:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583792.813924:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599044864:0@lo:13: 00000100:00100000:2.0:1784583792.813954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583792.813994:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044736 00000100:00100000:2.0:1784583792.814000:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044736 00000100:00100000:2.0:1784583792.814032:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044864 00000100:00100000:2.0:1784583792.814034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044864 00000100:00100000:2.0:1784583792.814047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784583792.814055:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599044736:12345-0@lo:13: 00002000:00000024:2.0:1784583792.814082:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583792.819113:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599044736:12345-0@lo:13: Request processed in 5046us (5289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583792.819129:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784583792.819161:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583792.819180:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599044864:12345-0@lo:13: 00002000:00000024:2.0:1784583792.819233:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583792.819315:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599044864:12345-0@lo:13: Request processed in 144us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583792.819321:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784583792.820080:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b404956d80 x1871271599044864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583792.820103:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599044864:0@lo:13: 00010000:00080000:3.0:1784583792.820582:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302b47480 x1871271599044736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583792.820598:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599044736:0@lo:13: 00000100:00100000:2.0:1784583793.332936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599044992:0@lo:41: 00000100:00100000:2.0:1784583793.333000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583793.333179:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599044992 00000100:00100000:0.0:1784583793.333198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599044992 00000100:00100000:0.0:1784583793.333245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784583793.333254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599044992:12345-0@lo:41: 00000004:00000024:0.0:1784583793.333286:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1784583793.333865:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599044992:0@lo:41: 00000100:00100000:0.0:1784583793.334032:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599044992:12345-0@lo:41: Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583793.334043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1784583793.837649:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583794.862911:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583795.885580:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583796.397872:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599045120:0@lo:41: 00000100:00100000:1.0:1784583796.397939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583796.398761:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045120 00000100:00100000:3.0:1784583796.398770:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045120 00000100:00100000:3.0:1784583796.398822:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784583796.398831:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599045120:12345-0@lo:41: 00000004:00000024:3.0:1784583796.398862:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784583796.398918:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599045120:12345-0@lo:41: Request processed in 88us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583796.398925:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784583796.399004:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599045120:0@lo:41: 00010000:00010000:3.0:1784583796.916685:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583797.432727:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599045248:0@lo:400: 00000100:00100000:1.0:1784583797.432801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.432848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599045760:0@lo:400: 00000100:00100000:1.0:1784583797.432870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.432894:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599046272:0@lo:400: 00000100:00100000:1.0:1784583797.432918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.432942:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784583797.432948:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599045632:0@lo:400: 00000100:00100000:1.0:1784583797.432971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.432987:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599046144:0@lo:400: 00000100:00100000:1.0:1784583797.433006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.433275:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599045376:0@lo:400: 00000100:00100000:1.0:1784583797.433301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.433319:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599045888:0@lo:400: 00000100:00100000:1.0:1784583797.433339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.433356:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784583797.433361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599045504:0@lo:400: 00000100:00100000:1.0:1784583797.433380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.433395:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599046016:0@lo:400: 00000100:00100000:1.0:1784583797.433432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.433458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045760 00000100:00100000:1.0:1784583797.433487:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045760 00000100:00100000:1.0:1784583797.433534:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045504 00000100:00100000:1.0:1784583797.433537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045504 00000100:00100000:1.0:1784583797.433553:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784583797.433562:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599045760:12345-0@lo:400: 00000100:00100000:1.0:1784583797.433611:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599045760:12345-0@lo:400: Request processed in 50us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.433617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784583797.433632:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583797.433638:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599045504:12345-0@lo:400: 00000100:00100000:1.0:1784583797.433868:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599045504:12345-0@lo:400: Request processed in 229us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.433875:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583797.433897:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046272 00000100:00100000:1.0:1784583797.433901:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046272 00000100:00100000:1.0:1784583797.433933:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046144 00000100:00100000:1.0:1784583797.433936:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046144 00000100:00100000:1.0:1784583797.433954:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583797.433961:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599046272:12345-0@lo:400: 00000100:00100000:1.0:1784583797.433991:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599046272:12345-0@lo:400: Request processed in 31us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.433998:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583797.434009:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784583797.434015:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599046144:12345-0@lo:400: 00000100:00100000:1.0:1784583797.434627:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599046144:12345-0@lo:400: Request processed in 611us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.434635:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784583797.434736:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045632 00000100:00100000:1.0:1784583797.434741:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045632 00000100:00100000:1.0:1784583797.434765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045376 00000100:00100000:1.0:1784583797.434768:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045376 00000100:00100000:1.0:1784583797.434778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045888 00000100:00100000:1.0:1784583797.434781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045888 00000100:00100000:1.0:1784583797.434868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046016 00000100:00100000:1.0:1784583797.434872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046016 00000100:00100000:1.0:1784583797.434890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784583797.434896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599045632:12345-0@lo:400: 00000100:00100000:1.0:1784583797.434924:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599045632:12345-0@lo:400: Request processed in 29us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.434938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784583797.434949:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784583797.434955:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599045376:12345-0@lo:400: 00000100:00100000:1.0:1784583797.434980:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599045376:12345-0@lo:400: Request processed in 25us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.434985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784583797.434995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784583797.435001:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599045888:12345-0@lo:400: 00000100:00100000:1.0:1784583797.435163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599045888:12345-0@lo:400: Request processed in 152us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.435171:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784583797.435186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784583797.435192:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599046016:12345-0@lo:400: 00000100:00100000:1.0:1784583797.435218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599046016:12345-0@lo:400: Request processed in 27us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.435223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1784583797.435277:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302425880 x1871271599045632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435292:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599045632:0@lo:400: 00010000:00080000:1.0:1784583797.435305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302427800 x1871271599046144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435312:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599046144:0@lo:400: 00000100:00100000:1.0:1784583797.435324:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599045760:0@lo:400: 00010000:00080000:1.0:1784583797.435333:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426680 x1871271599046272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435347:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599046272:0@lo:400: 00000100:00100000:1.0:1784583797.435390:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599045504:0@lo:400: 00010000:00080000:1.0:1784583797.435401:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424000 x1871271599046016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435410:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599046016:0@lo:400: 00010000:00080000:1.0:1784583797.435420:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302427100 x1871271599045376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435429:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599045376:0@lo:400: 00010000:00080000:1.0:1784583797.435439:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424e00 x1871271599045888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.435447:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599045888:0@lo:400: 00000100:00080000:1.0:1784583797.435491:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583797.435495:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583797.435497:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583797.435674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599045248 00000100:00100000:3.0:1784583797.435678:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599045248 00000100:00100000:3.0:1784583797.435712:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784583797.435717:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599045248:12345-0@lo:400: 00000100:00100000:3.0:1784583797.438179:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599045248:12345-0@lo:400: Request processed in 2452us (5369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583797.438192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784583797.445849:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599045248:0@lo:400: 00000100:00100000:1.0:1784583797.934137:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599046400:0@lo:13: 00000100:00100000:1.0:1784583797.934217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583797.934448:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046400 00000100:00100000:2.0:1784583797.934456:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046400 00000100:00100000:2.0:1784583797.934530:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784583797.934540:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599046400:12345-0@lo:13: 00002000:00000024:2.0:1784583797.934565:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583797.934607:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599046400:12345-0@lo:13: Request processed in 69us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583797.934614:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784583797.934697:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ea9c000 x1871271599046400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583797.934714:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599046400:0@lo:13: 00010000:00010000:0.0:1784583797.934984:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583797.935115:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599046528:0@lo:13: 00000100:00100000:3.0:1784583797.935166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583797.935316:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046528 00000100:00100000:1.0:1784583797.935321:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046528 00000100:00100000:1.0:1784583797.935358:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583797.935364:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599046528:12345-0@lo:13: 00002000:00000024:1.0:1784583797.935374:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583797.935410:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599046528:12345-0@lo:13: Request processed in 46us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583797.935416:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784583797.935693:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b4049bb480 x1871271599046528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583797.935707:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599046528:0@lo:13: 00000100:00100000:0.0:1784583798.456704:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599046656:0@lo:41: 00000100:00100000:0.0:1784583798.456765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583798.456831:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046656 00000100:00100000:0.0:1784583798.456837:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046656 00000100:00100000:0.0:1784583798.456880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784583798.456889:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599046656:12345-0@lo:41: 00000004:00000024:0.0:1784583798.456921:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1784583798.456963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599046656:12345-0@lo:41: Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583798.456970:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784583798.457136:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599046656:0@lo:41: 00010000:00010000:2.0:1784583798.957603:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784583799.807318:0:9505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784583799.807321:0:9505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784583799.807323:0:9505:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784583799.807452:0:9505:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b30245a800 00000020:01000004:1.0:1784583799.807823:0:9505:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784583799.807839:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784583799.807860:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98b302a48000) 00000020:00000080:1.0:1784583799.807885:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784583799.858082:0:9505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1784583799.858135:0:9505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1784583799.884082:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784583799.884444:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784583799.884457:0:9505:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784583799.884637:0:9505:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e477a7 00000020:01000004:0.0:1784583799.884645:0:9505:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784583799.884668:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784583799.884672:0:9505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784583799.884678:0:9505:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784583799.884707:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1784583799.884712:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784583799.913374:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784583799.913414:0:9505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1784583799.913418:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784583799.913420:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784583799.913421:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784583799.913423:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784583799.913424:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784583799.913426:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784583799.913427:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784583799.914002:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784583799.914006:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784583799.914008:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784583799.914010:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784583799.914014:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1784583799.914016:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784583799.914018:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784583799.914019:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784583799.914020:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784583799.914022:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784583799.914024:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784583799.914025:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784583799.914034:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784583799.914035:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784583799.914035:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784583799.914036:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784583799.914062:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784583799.914079:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599046784:0@lo:253: 00000100:00100000:1.0:1784583799.914166:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.914217:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583799.916011:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046784 00000100:00100000:2.0:1784583799.916024:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046784 00000100:00100000:2.0:1784583799.916088:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784583799.916099:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:9505:x1871271599046784:12345-0@lo:253: 20000000:01000000:2.0:1784583799.916154:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784583799.916158:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1784583799.916163:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1784583799.916166:0:6508:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1784583799.916458:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583799.917324:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1784583799.917343:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1784583799.917370:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1784583799.917378:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1784583799.917392:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1784583799.917409:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1784583799.917695:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1784583799.917712:0:6508:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583799.917714:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583799.917729:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1784583799.917738:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784583799.917752:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1784583799.917759:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583799.917772:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1784583799.917779:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784583799.917792:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1784583799.917809:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1784583799.917879:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1784583799.917889:0:6508:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583799.917891:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583799.917904:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1784583799.917910:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784583799.917936:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1784583799.917942:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583799.917955:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1784583799.917960:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784583799.917973:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1784583799.917987:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1784583799.918351:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1784583799.918363:0:6508:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:2.0:1784583799.918365:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:2.0:1784583799.918380:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1784583799.918386:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784583799.918423:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1784583799.918430:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:2.0:1784583799.918444:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1784583799.918450:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784583799.918463:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1784583799.921302:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1784583799.921325:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784583799.921328:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784583799.921345:0:6508:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784583799.921391:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784583799.921394:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784583799.923065:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1784583799.923120:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1784583799.923137:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1784583799.924211:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1784583799.924241:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1784583799.924260:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1784583799.924271:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784583799.924274:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784583799.931324:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1784583799.931376:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1784583799.931394:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1784583799.935014:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1784583799.935057:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1784583799.935072:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1784583799.935084:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784583799.935178:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784583799.942657:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1784583799.942722:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1784583799.942737:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784583799.943089:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784583799.943115:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1784583799.943153:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1784583799.943168:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1784583799.943170:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784583799.943858:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1784583799.943883:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1784583799.943900:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1784583799.944120:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1784583799.944153:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1784583799.944170:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1784583799.944181:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784583799.944183:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784583799.944755:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1784583799.944900:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1784583799.944990:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1784583799.945010:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:0.0:1784583799.945024:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784583799.945042:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945060:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4769d expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945068:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945074:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47706 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945081:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47722 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945088:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4774c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945095:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47768 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945117:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945125:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945168:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945182:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.945196:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599046912:0@lo:104: 00000100:00100000:0.0:1784583799.945256:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583799.945354:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945362:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 21 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.945370:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047040:0@lo:104: 00000100:00100000:0.0:1784583799.945388:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583799.945686:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.945694:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 21 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.945703:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047168:0@lo:104: 00000100:00100000:0.0:1784583799.945743:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.945786:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599046912 00000100:00100000:3.0:1784583799.945792:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599046912 00000100:00100000:3.0:1784583799.945824:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047040 00000100:00100000:3.0:1784583799.945827:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047040 00000100:00100000:3.0:1784583799.945840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583799.945848:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599046912:12345-0@lo:104: 00010000:00010000:3.0:1784583799.945858:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.945903:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583799.945908:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599046912:12345-0@lo:104: Request processed in 62us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.945924:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583799.945942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583799.945949:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599047040:12345-0@lo:104: 00010000:00010000:3.0:1784583799.945956:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.945984:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784583799.945995:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599047040:12345-0@lo:104: Request processed in 47us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.946001:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1784583799.946018:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784583799.946023:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946030:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583799.946033:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946040:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583799.946047:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583799.946052:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583799.946079:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946085:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583799.946102:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946108:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47799 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946120:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583799.946122:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946151:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583799.946155:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946161:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583799.946167:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583799.946173:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583799.946187:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946193:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583799.946208:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946215:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e47768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4776f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946223:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583799.946225:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583799.946227:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583799.946233:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583799.946249:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599047296:0@lo:103: 00000100:00100000:3.0:1784583799.946276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.946318:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599047424:0@lo:103: 00000100:00100000:3.0:1784583799.946588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.946625:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047296 00000100:00100000:3.0:1784583799.946629:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047296 00010000:00010000:3.0:1784583799.946648:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 22 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.946669:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047424 00000100:00100000:3.0:1784583799.946672:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047424 00010000:00010000:3.0:1784583799.946683:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 23 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.946700:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583799.946707:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599047296:12345-0@lo:103: 00010000:00010000:3.0:1784583799.946717:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.946723:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 23 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946732:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 23 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946748:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.946777:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599047296:12345-0@lo:103: Request processed in 70us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.946784:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583799.946796:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784583799.946802:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3641:x1871271599047424:12345-0@lo:103: 00010000:00010000:3.0:1784583799.946810:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.946814:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 22 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946834:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 22 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.946844:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.946872:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3641:x1871271599047424:12345-0@lo:103: Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.946879:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1784583799.947027:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.947037:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 21 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947047:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047552:0@lo:104: 00000100:00100000:0.0:1784583799.947071:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583799.947090:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.947098:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 21 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947106:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047680:0@lo:104: 00000100:00100000:0.0:1784583799.947126:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583799.947156:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.947165:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 21 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947173:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047808:0@lo:104: 00000100:00100000:0.0:1784583799.947196:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583799.947213:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.947221:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 21 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947243:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047936:0@lo:104: 00000100:00100000:0.0:1784583799.947263:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913540 going to sleep for 11 seconds 00010000:00010000:0.0:1784583799.947278:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97200/0xdab2421a42e47799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47792 expref: 21 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947290:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599046912:0@lo:104: 00010000:00010000:0.0:1784583799.947312:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97e00/0xdab2421a42e4776f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47768 expref: 20 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.947322:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047040:0@lo:104: 00000100:00100000:2.0:1784583799.947638:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047168 00000100:00100000:2.0:1784583799.947645:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047168 00000100:00100000:2.0:1784583799.947681:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784583799.947699:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583799.947708:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047552 00000100:00100000:2.0:1784583799.947711:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047552 00000100:00100000:2.0:1784583799.947725:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047680 00000100:00100000:2.0:1784583799.947728:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047680 00000100:00100000:2.0:1784583799.947738:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047808 00000100:00100000:2.0:1784583799.947740:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047808 00000100:00100000:2.0:1784583799.947749:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599047936 00000100:00100000:2.0:1784583799.947751:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599047936 00000100:00100000:2.0:1784583799.947763:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784583799.947770:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6508:x1871271599047168:12345-0@lo:104: 00010000:00010000:2.0:1784583799.947780:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.947876:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599047296:0@lo:103: 00000100:00100000:3.0:1784583799.947908:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599047424:0@lo:103: 00010000:00010000:2.0:1784583799.948905:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583799.948921:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:6508:x1871271599047168:12345-0@lo:104: Request processed in 1144us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.948930:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784583799.948954:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784583799.948962:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6508:x1871271599047552:12345-0@lo:104: 00010000:00010000:2.0:1784583799.948973:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.949023:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583799.949029:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:6508:x1871271599047552:12345-0@lo:104: Request processed in 69us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.949035:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784583799.949047:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784583799.949053:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6508:x1871271599047680:12345-0@lo:104: 00010000:00010000:2.0:1784583799.949061:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.949086:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784583799.949091:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:6508:x1871271599047680:12345-0@lo:104: Request processed in 39us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.949097:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784583799.949108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784583799.949114:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f792850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599047808:12345-0@lo:104: 00010000:00010000:2.0:1784583799.949121:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949232:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784583799.949238:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949246:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7aa00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583799.949250:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949258:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583799.949265:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583799.949271:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583799.949301:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949323:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583799.949337:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949344:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e4774c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47753 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949355:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784583799.949358:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949363:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583799.949366:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949372:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583799.949378:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583799.949382:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583799.949396:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949401:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583799.949410:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949416:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e47722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47729 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949431:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583799.949434:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949440:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583799.949443:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949449:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583799.949454:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583799.949459:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583799.949507:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949513:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583799.949518:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949524:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e47706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4770d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949533:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583799.949535:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583799.949536:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583799.949688:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583799.949695:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f792850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6508:x1871271599047808:12345-0@lo:104: Request processed in 580us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.949701:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784583799.949732:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784583799.949739:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599047936:12345-0@lo:104: 00010000:00010000:2.0:1784583799.949746:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.949775:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583799.949779:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6508:x1871271599047936:12345-0@lo:104: Request processed in 43us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.949785:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1784583799.949887:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784583799.949897:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949903:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583799.949906:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949921:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583799.949928:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583799.949933:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583799.949947:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949953:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583799.949960:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949966:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e476c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476ce expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949974:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583799.949977:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.949983:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583799.949986:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.950003:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583799.950009:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583799.950013:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583799.950026:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.950033:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583799.950037:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.950044:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982600/0xdab2421a42e4769d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476a4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.950057:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583799.950059:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583799.950060:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583799.950181:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048064:0@lo:103: 00000100:00100000:3.0:1784583799.950214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.950251:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048576:0@lo:103: 00000100:00100000:3.0:1784583799.950273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.950307:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583799.950314:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048448:0@lo:103: 00000100:00100000:3.0:1784583799.950335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.950363:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048064 00000100:00100000:3.0:1784583799.950370:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048064 00010000:00010000:3.0:1784583799.950391:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 20 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.950412:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048576 00000100:00100000:3.0:1784583799.950414:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048576 00010000:00010000:3.0:1784583799.950425:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 21 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.950435:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048448 00000100:00100000:3.0:1784583799.950444:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048448 00010000:00010000:3.0:1784583799.950457:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 22 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.951102:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047168:0@lo:104: 00000100:00100000:0.0:1784583799.951114:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047552:0@lo:104: 00000100:00100000:0.0:1784583799.951122:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047680:0@lo:104: 00000100:00100000:0.0:1784583799.951130:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047808:0@lo:104: 00000100:00100000:0.0:1784583799.951147:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1871271599047936:0@lo:104: 00010000:00010000:0.0:1784583799.951180:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.951453:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1784583799.951768:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583799.951862:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3642:x1871271599048064:12345-0@lo:103: 00010000:00010000:3.0:1784583799.951881:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.951888:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 22 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.951901:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 22 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.951916:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97800/0xdab2421a42e47753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4774c expref: 22 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.951930:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.952104:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3642:x1871271599048064:12345-0@lo:103: Request processed in 631us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.952113:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784583799.952135:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784583799.952154:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:3642:x1871271599048576:12345-0@lo:103: 00010000:00010000:3.0:1784583799.952162:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.952167:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 20 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952176:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 20 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952185:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216a200/0xdab2421a42e476a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4769d expref: 20 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952205:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.952241:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3642:x1871271599048576:12345-0@lo:103: Request processed in 89us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.952247:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784583799.952282:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784583799.952289:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3642:x1871271599048448:12345-0@lo:103: 00010000:00010000:3.0:1784583799.952295:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.952300:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 18 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952308:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 18 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952318:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983200/0xdab2421a42e476ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e476c7 expref: 18 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952328:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.952356:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3642:x1871271599048448:12345-0@lo:103: Request processed in 67us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.952361:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784583799.952390:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599048192:0@lo:103: 00000100:00100000:3.0:1784583799.952416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.952442:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583799.952447:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599048320:0@lo:103: 00000100:00100000:3.0:1784583799.952491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583799.952512:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048192 00000100:00100000:3.0:1784583799.952517:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048192 00010000:00010000:3.0:1784583799.952543:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 17 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.952558:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048320 00000100:00100000:3.0:1784583799.952561:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048320 00010000:00010000:3.0:1784583799.952586:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 18 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583799.952599:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583799.952605:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3639:x1871271599048192:12345-0@lo:103: 00010000:00010000:3.0:1784583799.952612:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.952616:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 18 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952625:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 18 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952635:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e47729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47722 expref: 18 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952644:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.952669:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3639:x1871271599048192:12345-0@lo:103: Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.952676:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583799.952687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583799.952693:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3639:x1871271599048320:12345-0@lo:103: 00010000:00010000:3.0:1784583799.952699:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583799.952703:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 16 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952722:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 16 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952731:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97400/0xdab2421a42e4770d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47706 expref: 16 pid: 6506 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952741:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952749:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952763:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952770:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952776:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952783:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952790:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216aa00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583799.952794:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952803:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952842:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.952852:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583799.952874:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3639:x1871271599048320:12345-0@lo:103: Request processed in 181us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.952880:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583799.952909:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599048320:0@lo:103: 00000100:00100000:3.0:1784583799.952917:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599048192:0@lo:103: 00010000:00010000:3.0:1784583799.953695:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.953707:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583799.953713:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216aa00/0xdab2421a42e477ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784583799.953728:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784583799.953830:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048064:0@lo:103: 00000100:00100000:0.0:1784583799.953840:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048576:0@lo:103: 00000100:00100000:0.0:1784583799.953856:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599048448:0@lo:103: 00000100:00100000:0.0:1784583799.958586:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:9505:x1871271599046784:12345-0@lo:253: Request processed in 42481us (44412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583799.958610:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784583799.958776:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599046784:0@lo:253: 10000000:01000000:1.0:1784583799.958791:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784583799.958794:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784583799.958796:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784583799.958797:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784583799.958798:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1784583799.958800:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784583799.958801:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784583799.958802:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784583799.958804:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784583799.958805:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784583799.958812:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784583799.958832:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b30245a800 from lustre-OST0001 10000000:01000000:1.0:1784583799.958861:0:9505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784583799.958864:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784583799.958873:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b4331acd40 local copy 10000000:01000000:1.0:1784583799.958877:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784583799.958908:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.958929:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.958938:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583799.958956:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048704:0@lo:101: 00000100:00100000:1.0:1784583799.958990:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.959021:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583799.959127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048704 00000100:00100000:2.0:1784583799.959134:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048704 00000100:00100000:2.0:1784583799.959179:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784583799.959188:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+14:9505:x1871271599048704:12345-0@lo:101: 00010000:00010000:2.0:1784583799.959200:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583799.959213:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e477bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e477b5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.959234:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e477bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e477b5 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.959245:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e477bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477b5 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.959266:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ba00, rc 0) 00000100:00100000:2.0:1784583799.959312:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599048704:12345-0@lo:101: Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.959317:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784583799.959604:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048704:0@lo:101: 00010000:00010000:1.0:1784583799.959617:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.959627:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583799.959709:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048832:0@lo:501: 00000100:00100000:1.0:1784583799.959734:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.959761:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583799.959799:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048832 00000100:00100000:2.0:1784583799.959803:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048832 00000100:00100000:2.0:1784583799.959832:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784583799.959839:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599048832:12345-0@lo:501: 00000100:00100000:2.0:1784583799.959888:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599048832:12345-0@lo:501: Request processed in 50us (153us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784583799.959895:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784583799.960054:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048832:0@lo:501: 10000000:01000000:1.0:1784583799.960065:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784583799.960086:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784583799.960091:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.960100:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.960107:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.960128:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784583799.960156:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b30245a800 10000000:01000000:1.0:1784583799.960161:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784583799.960166:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784583799.960168:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784583799.960172:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784583799.960175:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784583799.960191:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.960198:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.960205:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583799.960216:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048960:0@lo:101: 00000100:00100000:1.0:1784583799.960242:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.960262:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784583799.960320:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583799.960327:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.960557:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583799.960562:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.960570:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583799.960579:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583799.960585:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784583799.960605:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.960611:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583799.960639:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.960647:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e477b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdab2421a42e477bc expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.960657:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583799.960659:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583799.960661:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583799.960804:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599049088:0@lo:103: 00000100:00100000:3.0:1784583799.960837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583799.961121:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599048960 00000100:00100000:2.0:1784583799.961127:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599048960 00000100:00100000:2.0:1784583799.961200:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784583799.961208:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599048960:12345-0@lo:101: 00010000:00010000:2.0:1784583799.961218:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583799.961228:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e477c3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.961244:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.961254:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583799.961261:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a000, rc 0) 00000100:00100000:0.0:1784583799.961326:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049088 00000100:00100000:0.0:1784583799.961346:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049088 00000100:00100000:0.0:1784583799.961379:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583799.961385:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3639:x1871271599049088:12345-0@lo:103: 00010000:00010000:0.0:1784583799.961394:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583799.961404:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e477bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e477b5 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583799.961414:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583799.961445:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:3639:x1871271599049088:12345-0@lo:103: Request processed in 60us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583799.961451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784583799.961702:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599048960:12345-0@lo:101: Request processed in 494us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583799.961715:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784583799.961792:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599049088:0@lo:103: 00000100:00100000:1.0:1784583799.964056:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599048960:0@lo:101: 00010000:00010000:1.0:1784583799.964099:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583799.964111:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583799.964595:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049216:0@lo:501: 00000100:00100000:0.0:1784583799.964652:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583799.964698:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913900 going to sleep for 11 seconds 00000100:00100000:3.0:1784583799.964745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049216 00000100:00100000:3.0:1784583799.964751:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049216 00000100:00100000:3.0:1784583799.964793:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784583799.964801:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049216:12345-0@lo:501: 00000100:00100000:3.0:1784583799.964926:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049216:12345-0@lo:501: Request processed in 126us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.964934:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784583799.965014:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049216:0@lo:501: 00000100:00100000:1.0:1784583799.965046:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049344:0@lo:503: 00000100:00100000:1.0:1784583799.965088:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.965110:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583799.965146:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049344 00000100:00100000:3.0:1784583799.965150:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049344 00000100:00100000:3.0:1784583799.965179:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784583799.965186:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049344:12345-0@lo:503: 00000100:00100000:3.0:1784583799.965273:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049344:12345-0@lo:503: Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.965280:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784583799.965448:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049344:0@lo:503: 00000040:00080000:0.0:1784583799.966094:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784583799.966170:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049472:0@lo:502: 00000100:00100000:0.0:1784583799.966211:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583799.966242:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913900 going to sleep for 11 seconds 00000100:00100000:3.0:1784583799.966289:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049472 00000100:00100000:3.0:1784583799.966293:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049472 00000100:00100000:3.0:1784583799.966327:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784583799.966335:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049472:12345-0@lo:502: 00000100:00100000:3.0:1784583799.966423:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049472:12345-0@lo:502: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.966430:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784583799.966603:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049472:0@lo:502: 00000040:00080000:1.0:1784583799.967180:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784583799.967207:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784583799.967223:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784583799.967238:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784583799.967251:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784583799.967265:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784583799.967293:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049600:0@lo:502: 00000100:00100000:1.0:1784583799.967348:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583799.967620:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583799.969396:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049600 00000100:00100000:3.0:1784583799.969408:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049600 00000100:00100000:3.0:1784583799.969462:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784583799.969487:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049600:12345-0@lo:502: 00000100:00100000:3.0:1784583799.969630:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049600:12345-0@lo:502: Request processed in 146us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583799.969637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784583799.969764:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049600:0@lo:502: 00000040:00080000:2.0:1784583799.969843:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784583799.969857:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1784583799.970678:0:9516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784583799.970686:0:9516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1784583799.970692:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583799.970695:0:9516:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784583799.970700:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784583799.970714:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98b4049dcd40) 00000020:00000080:0.0:1784583799.970736:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784583799.970740:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784583799.970809:0:9516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b30245a800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784583799.970817:0:9516:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784583799.970824:0:9516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e477d8 00010000:00010000:0.0:1784583799.979089:0:9516:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1784583799.979348:0:9516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00010000:00010000:0.0:1784583799.988674:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784583799.990618:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784583799.991170:0:9516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784583799.996296:0:9516:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1784583799.996589:0:9516:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1784583800.004453:0:9516:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1784583800.007862:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784583800.007875:0:9516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583800.007881:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583800.007883:0:9516:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784583800.007886:0:9516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583800.007889:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583800.007890:0:9516:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784583800.007898:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784583800.007900:0:9516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784583800.007919:0:9516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583800.007921:0:9516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583800.007923:0:9516:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784583800.007925:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784583800.008125:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1784583800.008167:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784583800.008183:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.008195:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583800.008203:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b30245a800 from 1 10000000:01000000:2.0:1784583800.008205:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784583800.008240:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.008248:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.008259:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583800.008282:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049728:0@lo:101: 00000100:00100000:2.0:1784583800.008357:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583800.008399:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583800.010071:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049728 00000100:00100000:1.0:1784583800.010081:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049728 00000100:00100000:1.0:1784583800.010127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784583800.010134:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:9505:x1871271599049728:12345-0@lo:101: 00010000:00010000:1.0:1784583800.010156:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583800.010171:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e477df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.010193:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e477df expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.010203:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477df expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.010211:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982600, rc 0) 00000100:00100000:1.0:1784583800.010267:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599049728:12345-0@lo:101: Request processed in 134us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.010273:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784583800.010328:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049728:0@lo:101: 00010000:00010000:1.0:1784583800.010343:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.010352:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583800.010454:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049856:0@lo:501: 00000100:00100000:1.0:1784583800.010504:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.010530:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583800.010544:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049856 00000100:00100000:1.0:1784583800.010549:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049856 00000100:00100000:1.0:1784583800.010571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784583800.010578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599049856:12345-0@lo:501: 00000100:00100000:1.0:1784583800.010664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599049856:12345-0@lo:501: Request processed in 86us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.010670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784583800.010702:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049856:0@lo:501: 00000100:00100000:1.0:1784583800.010727:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049984:0@lo:503: 00000100:00100000:1.0:1784583800.010765:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.010778:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583800.010790:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599049984 00000100:00100000:1.0:1784583800.010793:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599049984 00000100:00100000:1.0:1784583800.010813:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784583800.010819:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599049984:12345-0@lo:503: 00000100:00100000:1.0:1784583800.010887:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599049984:12345-0@lo:503: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.010893:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784583800.010930:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599049984:0@lo:503: 00000040:00080000:1.0:1784583800.011135:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784583800.011204:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050112:0@lo:502: 00000100:00100000:1.0:1784583800.011240:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.011255:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583800.011269:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050112 00000100:00100000:1.0:1784583800.011272:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050112 00000100:00100000:1.0:1784583800.011296:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784583800.011302:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599050112:12345-0@lo:502: 00000100:00100000:1.0:1784583800.011369:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599050112:12345-0@lo:502: Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.011375:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784583800.011415:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050112:0@lo:502: 00000040:00080000:1.0:1784583800.011597:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784583800.011621:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784583800.011638:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050240:0@lo:502: 00000100:00100000:1.0:1784583800.011670:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.011683:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583800.011696:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050240 00000100:00100000:1.0:1784583800.011699:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050240 00000100:00100000:1.0:1784583800.011720:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784583800.011726:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599050240:12345-0@lo:502: 00000100:00100000:1.0:1784583800.011785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599050240:12345-0@lo:502: Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.011792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784583800.011830:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050240:0@lo:502: 00000040:00080000:1.0:1784583800.011864:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784583800.011871:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784583800.015781:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583800.015792:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583800.015799:0:9520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784583800.015806:0:9520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b30245a800 00000020:00000080:3.0:1784583800.015809:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784583800.015820:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583800.015823:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583800.015824:0:9520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784583800.015827:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784583800.016048:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784583800.016076:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784583800.016148:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.016161:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583800.016208:0:9505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784583800.016211:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b30245a800 10000000:01000000:1.0:1784583800.016214:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b30245a800 10000000:01000000:1.0:1784583800.016218:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784583800.016223:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b30245a800 from 1 10000000:01000000:1.0:1784583800.016226:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784583800.016258:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.016267:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.016278:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583800.016299:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050368:0@lo:101: 00000100:00100000:1.0:1784583800.016358:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.016399:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583800.016448:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050368 00000100:00100000:2.0:1784583800.016455:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050368 00000100:00100000:2.0:1784583800.016522:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784583800.016531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9505:x1871271599050368:12345-0@lo:101: 00010000:00010000:2.0:1784583800.016543:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583800.016554:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e477ed expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.016574:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e477ed expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.016583:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477ed expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.016591:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b600, rc 0) 00000100:00100000:2.0:1784583800.016632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050368:12345-0@lo:101: Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.016638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784583800.016802:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050368:0@lo:101: 00010000:00010000:3.0:1784583800.016816:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583800.016824:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583800.016909:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050496:0@lo:501: 00000100:00100000:3.0:1784583800.016944:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583800.016969:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583800.017093:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050496 00000100:00100000:2.0:1784583800.017098:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050496 00000100:00100000:2.0:1784583800.017129:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784583800.017136:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050496:12345-0@lo:501: 00000100:00100000:2.0:1784583800.017232:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050496:12345-0@lo:501: Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.017239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784583800.017335:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050496:0@lo:501: 00000100:00100000:3.0:1784583800.017360:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050624:0@lo:503: 00000100:00100000:3.0:1784583800.017398:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583800.017420:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784583800.017458:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050624 00000100:00100000:0.0:1784583800.017463:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050624 00000100:00100000:0.0:1784583800.017508:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784583800.017514:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050624:12345-0@lo:503: 00000100:00100000:0.0:1784583800.017591:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050624:12345-0@lo:503: Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583800.017598:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784583800.017705:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050624:0@lo:503: 00000040:00080000:3.0:1784583800.018058:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784583800.018115:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050752:0@lo:502: 00000100:00100000:3.0:1784583800.018161:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583800.018219:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583800.019701:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050752 00000100:00100000:2.0:1784583800.019725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050752 00000100:00100000:2.0:1784583800.019811:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784583800.019822:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050752:12345-0@lo:502: 00000100:00100000:2.0:1784583800.020013:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050752:12345-0@lo:502: Request processed in 192us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.020021:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784583800.020105:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050752:0@lo:502: 00000040:00080000:3.0:1784583800.020330:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784583800.020361:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784583800.020388:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784583800.020403:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784583800.020417:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784583800.020426:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784583800.020438:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784583800.020451:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784583800.020463:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784583800.020510:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784583800.020523:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784583800.020536:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784583800.020547:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784583800.020559:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784583800.020572:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784583800.020585:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784583800.020599:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784583800.020612:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784583800.020635:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784583800.020651:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784583800.020664:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784583800.020677:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784583800.020689:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784583800.020701:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784583800.020713:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1784583800.020725:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1784583800.020737:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1784583800.020749:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1784583800.020761:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1784583800.020774:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1784583800.020786:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1784583800.020799:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1784583800.020819:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1784583800.020831:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1784583800.020852:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1784583800.020866:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1784583800.020878:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1784583800.020890:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1784583800.020903:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1784583800.020921:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1784583800.020936:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1784583800.020949:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1784583800.020961:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1784583800.020973:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1784583800.020986:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1784583800.020998:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1784583800.021030:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050880:0@lo:502: 00000100:00100000:3.0:1784583800.021077:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583800.021729:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599050880 00000100:00100000:0.0:1784583800.021737:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599050880 00000100:00100000:0.0:1784583800.021774:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784583800.021781:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050880:12345-0@lo:502: 00000100:00100000:0.0:1784583800.021880:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599050880:12345-0@lo:502: Request processed in 99us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583800.021887:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784583800.022055:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583800.022076:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599050880:0@lo:502: 00000040:00080000:3.0:1784583800.022128:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1784583800.022149:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1784583800.022692:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784583800.022707:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98b302a4b380) 00000020:00000080:1.0:1784583800.022729:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1784583800.022990:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b30245a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784583800.022994:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b30245a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784583800.022997:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b30245a800 3 00010000:00080000:1.0:1784583800.023025:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b30376b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784583800.030657:0:9521:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1784583800.030775:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784583800.030823:0:9521:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784583800.030835:0:9521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdab2421a42e47802 00000100:00080000:1.0:1784583800.030844:0:9521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784583800.030851:0:9521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b30376b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583800.030887:0:9521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302426680 x1871271599051008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583800.031023:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599051008:0@lo:38: 00000100:00100000:3.0:1784583800.031087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.031189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051008 00000100:00100000:1.0:1784583800.031197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051008 00000100:00100000:1.0:1784583800.031227:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784583800.031234:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599051008:12345-0@lo:38: 00010000:00080000:1.0:1784583800.031254:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1784583800.031280:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdab2421a42e47809 00000004:00100000:1.0:1784583800.031293:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784583800.031320:0:6516:0:(import.c:65:import_set_state_nolock()) ffff98b30376e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583800.031363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1871271599051008:12345-0@lo:38: Request processed in 128us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.031370:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784583800.031389:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784583800.031706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599051136:0@lo:400: 00000100:00100000:1.0:1784583800.031734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583800.031939:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599051264:0@lo:400: 00000100:00100000:0.0:1784583800.031971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784583800.032112:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302426680 x1871271599051008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583800.032122:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784583800.032130:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784583800.032146:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784583800.032150:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784583800.032153:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583800.032167:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599051008:0@lo:38: 00000100:00100000:2.0:1784583800.032534:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051264 00000100:00100000:2.0:1784583800.032541:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051264 00000100:00100000:2.0:1784583800.032581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784583800.032589:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599051264:12345-0@lo:400: 00000100:00100000:2.0:1784583800.032631:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599051264:12345-0@lo:400: Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.032638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784583800.032659:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599051392:0@lo:400: 00000100:00100000:2.0:1784583800.032685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583800.032703:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599051904:0@lo:400: 00000100:00100000:2.0:1784583800.032724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.035290:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599051648:0@lo:400: 00000100:00100000:1.0:1784583800.035350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.035387:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784583800.035394:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599051520:0@lo:400: 00000100:00100000:1.0:1784583800.035428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.035447:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599052032:0@lo:400: 00000100:00100000:1.0:1784583800.035507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.035546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051136 00000100:00100000:1.0:1784583800.035553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051136 00000100:00100000:0.0:1784583800.035638:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599051264:0@lo:400: 00000100:00100000:0.0:1784583800.035646:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599051776:0@lo:400: 00000100:00100000:0.0:1784583800.035671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583800.036619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051392 00000100:00100000:0.0:1784583800.036628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051392 00000100:00100000:1.0:1784583800.038049:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051648 00000100:00100000:1.0:1784583800.038061:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051648 00000100:00080000:2.0:1784583800.038779:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583800.038796:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051904 00000100:00100000:2.0:1784583800.038802:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051904 00000100:00100000:2.0:1784583800.038844:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052032 00000100:00100000:2.0:1784583800.038847:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052032 00000100:00100000:2.0:1784583800.038871:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784583800.038880:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599051904:12345-0@lo:400: 00000100:00100000:2.0:1784583800.038980:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599051904:12345-0@lo:400: Request processed in 101us (6253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.038987:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784583800.039014:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784583800.039020:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599052032:12345-0@lo:400: 00000100:00100000:2.0:1784583800.039058:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599052032:12345-0@lo:400: Request processed in 39us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.039063:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784583800.039098:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427100 x1871271599051904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583800.039111:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599051904:0@lo:400: 00000100:00100000:2.0:1784583800.039147:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051520 00000100:00100000:2.0:1784583800.039152:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051520 00000100:00100000:2.0:1784583800.039175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784583800.039181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599051520:12345-0@lo:400: 00000100:00100000:2.0:1784583800.039216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599051520:12345-0@lo:400: Request processed in 35us (3787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.039223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:01000004:2.0:1784583800.039319:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784583800.039334:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98b4071a8000) 00000020:00000080:2.0:1784583800.039354:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1784583800.039519:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b30245a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784583800.039523:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b30245a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784583800.039526:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b30245a800 3 00010000:00080000:2.0:1784583800.039564:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b404995800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.151@tcp at head 00000100:00080000:3.0:1784583800.040653:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583800.043289:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599051776 00000100:00100000:1.0:1784583800.043304:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599051776 00000100:00100000:1.0:1784583800.043358:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784583800.043367:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599051136:12345-0@lo:400: 00000100:00100000:1.0:1784583800.043458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599051136:12345-0@lo:400: Request processed in 92us (11722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.043485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784583800.043501:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784583800.043508:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599051392:12345-0@lo:400: 00000100:00100000:1.0:1784583800.043552:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599051392:12345-0@lo:400: Request processed in 45us (10866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.043558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784583800.043583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784583800.043589:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599051648:12345-0@lo:400: 00000100:00100000:1.0:1784583800.043615:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599051648:12345-0@lo:400: Request processed in 27us (8265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.043621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784583800.043631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784583800.043637:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599051776:12345-0@lo:400: 00000100:00100000:1.0:1784583800.043839:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599051776:12345-0@lo:400: Request processed in 201us (8166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.043857:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784583800.044038:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784583800.047381:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424e00 x1871271599051776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583800.047825:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599051776:0@lo:400: 00010000:00080000:1.0:1784583800.047875:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302425880 x1871271599051392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583800.047886:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599051392:0@lo:400: 00000100:00100000:1.0:1784583800.047918:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599051520:0@lo:400: 00010000:00080000:1.0:1784583800.047931:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427b80 x1871271599052032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583800.047940:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599052032:0@lo:400: 00010000:00010000:2.0:1784583800.048488:0:9521:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1784583800.048588:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784583800.048633:0:9521:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784583800.048646:0:9521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdab2421a42e47817 00000100:00080000:2.0:1784583800.048654:0:9521:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784583800.048659:0:9521:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98b404995800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583800.048697:0:9521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ea9d880 x1871271599052160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:1.0:1784583800.048719:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302425f80 x1871271599051136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583800.048732:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599051136:0@lo:400: 00000100:00100000:3.0:1784583800.048888:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599052160:0@lo:38: 00000100:00100000:3.0:1784583800.048965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784583800.049020:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:1.0:1784583800.049291:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424000 x1871271599051648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583800.049302:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599051648:0@lo:400: 00000100:00100000:1.0:1784583800.049341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052160 00000100:00100000:1.0:1784583800.049346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052160 00000100:00100000:1.0:1784583800.049390:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784583800.049406:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599052160:12345-0@lo:38: 00010000:00080000:1.0:1784583800.049431:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1784583800.049661:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdab2421a42e4781e 00000004:00100000:1.0:1784583800.049678:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784583800.049709:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98b30376e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784583800.050951:0:9523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1871271599052288:0@lo:901: 00000100:00100000:0.0:1784583800.051003:0:9523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583800.051040:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052288 00000100:00100000:0.0:1784583800.051044:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052288 00000100:00100000:0.0:1784583800.051101:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583800.051109:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1871271599052288:12345-0@lo:901: 00000100:00100000:0.0:1784583800.052084:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1871271599052288:12345-0@lo:901: Request processed in 973us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583800.052095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784583800.052125:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583800.052517:0:9523:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43e8be540 going to sleep for 11 seconds 00010000:00080000:0.0:1784583800.052545:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef18700 x1871271599052288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784583816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583800.052558:0:9523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1871271599052288:0@lo:901: 00000100:00100000:1.0:1784583800.052950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1871271599052160:12345-0@lo:38: Request processed in 3541us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.052960:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784583800.056697:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9d880 x1871271599052160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784583810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583800.056712:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784583800.056723:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784583800.056732:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784583800.056737:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784583800.056740:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b404995800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784583800.056747:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599052160:0@lo:38: 00000040:00080000:2.0:1784583800.057676:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1784583800.058107:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1784583800.058135:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784583800.058168:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583800.058179:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784583800.058229:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784583800.058232:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784583800.058233:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784583800.058234:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784583800.058235:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784583800.058237:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784583800.058238:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784583800.058240:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784583800.058246:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784583800.058248:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784583800.058249:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784583800.058252:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1784583800.058255:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784583800.058256:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784583800.058257:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784583800.058258:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784583800.058259:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784583800.058260:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784583800.058261:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784583800.058262:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784583800.058263:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784583800.058264:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784583800.058264:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784583800.058286:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784583800.058303:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599052416:0@lo:253: 00000100:00100000:3.0:1784583800.058366:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583800.058402:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583800.058422:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052416 00000100:00100000:3.0:1784583800.058428:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052416 00000100:00100000:3.0:1784583800.059118:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784583800.059129:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599052416:12345-0@lo:253: 20000000:01000000:3.0:1784583800.059167:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784583800.059180:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784583800.071874:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784583800.071898:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784583800.072064:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784583800.072069:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784583800.072089:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072107:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47714 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072116:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4775a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072124:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072175:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072189:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 17 pid: 6507 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583800.072221:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599052544:0@lo:104: 00000100:00100000:0.0:1784583800.072282:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583800.072339:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.072348:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 17 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583800.072357:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599052672:0@lo:104: 00000100:00100000:0.0:1784583800.072377:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583800.072440:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43e8be540 going to sleep for 11 seconds 00000100:00100000:2.0:1784583800.072664:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052544 00000100:00100000:2.0:1784583800.072672:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052544 00000100:00100000:2.0:1784583800.072705:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052672 00000100:00100000:2.0:1784583800.072708:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052672 00000100:00100000:2.0:1784583800.072721:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784583800.072729:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599052544:12345-0@lo:104: 00010000:00010000:2.0:1784583800.072742:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.073941:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583800.073952:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:6530:x1871271599052544:12345-0@lo:104: Request processed in 1222us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.073961:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784583800.073986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784583800.073994:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599052672:12345-0@lo:104: 00010000:00010000:2.0:1784583800.074006:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583800.074056:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583800.074061:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:6530:x1871271599052672:12345-0@lo:104: Request processed in 69us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.074067:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784583800.074258:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9505:x1871271599052416:12345-0@lo:253: Request processed in 15131us (15891us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583800.074280:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784583800.074372:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48a91d92-bcef-47e2-812f-ada1e5d741c7:9505:1871271599052416:0@lo:253: 10000000:01000000:3.0:1784583800.074385:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784583800.074388:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784583800.074389:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784583800.074390:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784583800.074392:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784583800.074393:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784583800.074394:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784583800.074402:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784583800.074403:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784583800.074404:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784583800.074405:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784583800.074407:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784583800.074419:0:9505:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784583800.074795:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784583800.074804:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074825:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583800.074829:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074838:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583800.074846:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583800.074852:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583800.074891:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074898:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583800.074914:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074922:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97000/0xdab2421a42e4775a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47761 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074947:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583800.074951:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074957:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583800.074960:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074968:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583800.074975:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583800.074981:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784583800.074994:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.074999:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583800.075011:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075018:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e47714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4771b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075031:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583800.075033:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583800.075035:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583800.075046:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599052800:0@lo:103: 00000100:00100000:1.0:1784583800.075084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.075128:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599052928:0@lo:103: 00000100:00100000:1.0:1784583800.075162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583800.075191:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052800 00000100:00100000:1.0:1784583800.075197:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052800 00010000:00010000:1.0:1784583800.075218:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 17 pid: 6507 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583800.075241:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599052928 00000100:00100000:1.0:1784583800.075244:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599052928 00010000:00010000:1.0:1784583800.075253:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 18 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583800.075271:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784583800.075277:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3640:x1871271599052800:12345-0@lo:103: 00010000:00010000:1.0:1784583800.075287:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583800.075292:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 18 pid: 6507 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075301:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 18 pid: 6507 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075316:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583800.075342:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:3640:x1871271599052800:12345-0@lo:103: Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.075348:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784583800.075361:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784583800.075366:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3641:x1871271599052928:12345-0@lo:103: 00010000:00010000:1.0:1784583800.075374:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583800.075383:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 17 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075391:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 17 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075403:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075410:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784583800.075423:0:8443:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008569231s 00010000:00010000:1.0:1784583800.075427:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075434:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075441:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075447:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075453:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583800.075457:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075464:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075504:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583800.075519:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583800.075544:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:3641:x1871271599052928:12345-0@lo:103: Request processed in 178us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583800.075550:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784583800.075578:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599052928:0@lo:103: 00000100:00100000:1.0:1784583800.075597:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599052800:0@lo:103: 00010000:00010000:0.0:1784583800.076600:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96800/0xdab2421a42e47761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4775a expref: 16 pid: 6507 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583800.076616:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599052544:0@lo:104: 00010000:00010000:0.0:1784583800.076628:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216b800/0xdab2421a42e4771b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47714 expref: 15 pid: 6508 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583800.076636:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1871271599052672:0@lo:104: 00010000:00010000:0.0:1784583800.076655:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.076664:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.076670:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.076688:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216a600/0xdab2421a42e47825 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583800.076707:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784583800.079043:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1784583800.079228:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1784583800.079403:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1784583800.080368:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1784583800.080753:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1784583800.081613:0:9505:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1784583800.085705:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784583800.099463:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784583800.099548:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784583800.099586:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784583800.099901:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784583800.099924:0:9505:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784583800.099943:0:9505:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784583800.104388:0:9505:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583800.104605:0:9505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1784583801.005836:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583801.042883:0:9577:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583801.043148:0:9577:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784583801.517860:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599053056:0@lo:41: 00000100:00100000:1.0:1784583801.517926:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583801.518097:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053056 00000100:00100000:3.0:1784583801.518105:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053056 00000100:00100000:3.0:1784583801.518164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784583801.518174:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599053056:12345-0@lo:41: 00000004:00000024:3.0:1784583801.518207:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784583801.518410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599053056:12345-0@lo:41: Request processed in 236us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583801.518417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784583801.525260:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599053056:0@lo:41: 00010000:00010000:0.0:1784583802.030953:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583803.053881:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599053184:0@lo:13: 00000100:00100000:1.0:1784583803.053943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583803.054081:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053184 00000100:00100000:2.0:1784583803.054089:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053184 00000100:00100000:2.0:1784583803.054151:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784583803.054161:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599053184:12345-0@lo:13: 00002000:00000024:2.0:1784583803.054187:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583803.054227:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599053184:12345-0@lo:13: Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583803.054233:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784583803.054266:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9d500 x1871271599053184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583803.054282:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599053184:0@lo:13: 00000100:00080000:0.0:1784583803.054425:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583803.054616:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599053312:0@lo:13: 00000100:00100000:3.0:1784583803.054646:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583803.054718:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053312 00000100:00100000:2.0:1784583803.054722:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053312 00000100:00100000:2.0:1784583803.054758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784583803.054763:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599053312:12345-0@lo:13: 00002000:00000024:2.0:1784583803.054773:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583803.054801:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599053312:12345-0@lo:13: Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583803.054807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784583803.054829:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9d500 x1871271599053312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583803.054842:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599053312:0@lo:13: 00000100:00080000:3.0:1784583803.054895:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784583803.054983:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583803.573332:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599053440:0@lo:41: 00000100:00100000:3.0:1784583803.573394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583803.573531:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053440 00000100:00100000:3.0:1784583803.573538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053440 00000100:00100000:3.0:1784583803.573584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784583803.573601:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599053440:12345-0@lo:41: 00000004:00000024:3.0:1784583803.573648:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1784583803.573690:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599053440:12345-0@lo:41: Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583803.573697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784583803.573740:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599053440:0@lo:41: 00010000:00010000:1.0:1784583804.078501:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583805.105139:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599053568:0@lo:400: 00000100:00100000:2.0:1784583805.105214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.105297:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054080:0@lo:400: 00000100:00100000:2.0:1784583805.105326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.105346:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054592:0@lo:400: 00000100:00100000:1.0:1784583805.105349:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053568 00000100:00100000:1.0:1784583805.105358:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053568 00000100:00100000:2.0:1784583805.105369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.105397:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784583805.105404:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599053952:0@lo:400: 00000100:00100000:1.0:1784583805.105432:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784583805.105444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583805.105447:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3642:x1871271599053568:12345-0@lo:400: 00000100:00100000:2.0:1784583805.105489:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599054464:0@lo:400: 00000100:00100000:2.0:1784583805.105526:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583805.105537:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:3642:x1871271599053568:12345-0@lo:400: Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.105555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784583805.105560:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599053568:0@lo:400: 00000100:00100000:2.0:1784583805.105604:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599053696:0@lo:400: 00000100:00100000:2.0:1784583805.105636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.105660:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599054208:0@lo:400: 00000100:00100000:1.0:1784583805.105731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053952 00000100:00100000:1.0:1784583805.105736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053952 00000100:00100000:1.0:1784583805.105784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053696 00000100:00100000:1.0:1784583805.105787:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053696 00000100:00100000:1.0:1784583805.105821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784583805.105828:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599053952:12345-0@lo:400: 00000100:00100000:1.0:1784583805.105867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599053952:12345-0@lo:400: Request processed in 39us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.105873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784583805.105885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784583805.105890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599053696:12345-0@lo:400: 00000100:00100000:1.0:1784583805.105917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599053696:12345-0@lo:400: Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.105922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784583805.106874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.106903:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599054720:0@lo:400: 00000100:00100000:2.0:1784583805.106929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784583805.106965:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9ce00 x1871271599053696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.106978:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599053696:0@lo:400: 00000100:00100000:2.0:1784583805.106991:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784583805.106997:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599053824:0@lo:400: 00000100:00100000:2.0:1784583805.107017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.107034:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599054336:0@lo:400: 00000100:00100000:2.0:1784583805.107051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.107072:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599054848:0@lo:400: 00000100:00100000:2.0:1784583805.107125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583805.107161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054080 00000100:00100000:2.0:1784583805.107166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054080 00000100:00100000:1.0:1784583805.107179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054208 00000100:00100000:1.0:1784583805.107186:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054208 00000100:00100000:2.0:1784583805.107195:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599053824 00000100:00100000:2.0:1784583805.107199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599053824 00000100:00100000:2.0:1784583805.107213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583805.107220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054080:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107256:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054080:12345-0@lo:400: Request processed in 36us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583805.107262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583805.107274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583805.107280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599053824:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107305:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599053824:12345-0@lo:400: Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583805.107311:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583805.107326:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054592 00000100:00100000:2.0:1784583805.107329:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054592 00000100:00100000:1.0:1784583805.107506:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054720 00000100:00100000:1.0:1784583805.107511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054720 00000100:00100000:2.0:1784583805.107572:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054464 00000100:00100000:2.0:1784583805.107576:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054464 00000100:00100000:2.0:1784583805.107595:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784583805.107600:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054592:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107630:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054592:12345-0@lo:400: Request processed in 30us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583805.107636:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784583805.107645:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784583805.107650:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599054464:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107671:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599054464:12345-0@lo:400: Request processed in 21us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583805.107682:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784583805.107702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054336 00000100:00100000:2.0:1784583805.107705:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054336 00000100:00100000:2.0:1784583805.107734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054848 00000100:00100000:2.0:1784583805.107736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054848 00000100:00100000:1.0:1784583805.107740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784583805.107750:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599054208:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107763:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784583805.107771:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784583805.107793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599054208:12345-0@lo:400: Request processed in 44us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.107800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784583805.107816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784583805.107823:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599054720:12345-0@lo:400: 00000100:00100000:1.0:1784583805.107855:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599054720:12345-0@lo:400: Request processed in 32us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.107862:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784583805.107875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784583805.107881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599054336:12345-0@lo:400: 00000100:00100000:2.0:1784583805.107887:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784583805.107898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784583805.107908:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599054848:12345-0@lo:400: 00000100:00100000:1.0:1784583805.107913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599054336:12345-0@lo:400: Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583805.107928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784583805.107949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599054848:12345-0@lo:400: Request processed in 43us (822us total) trans 0 rc 0/0 00000100:00080000:1.0:1784583805.107951:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583805.107957:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583805.107960:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1784583805.107961:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583805.107994:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599053824:0@lo:400: 00010000:00080000:2.0:1784583805.108006:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9ca80 x1871271599054336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108015:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599054336:0@lo:400: 00010000:00080000:2.0:1784583805.108023:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9e300 x1871271599054848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108031:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599054848:0@lo:400: 00010000:00080000:2.0:1784583805.108040:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9f480 x1871271599054208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108047:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599054208:0@lo:400: 00010000:00080000:2.0:1784583805.108056:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9c380 x1871271599054720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108075:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599054720:0@lo:400: 00010000:00080000:2.0:1784583805.108120:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9fb80 x1871271599053952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108129:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599053952:0@lo:400: 00010000:00080000:2.0:1784583805.108139:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9ea00 x1871271599054464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108146:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599054464:0@lo:400: 00000100:00100000:2.0:1784583805.108156:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054080:0@lo:400: 00010000:00080000:2.0:1784583805.108164:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9dc00 x1871271599054592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583805.108172:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054592:0@lo:400: 00010000:00010000:0.0:1784583805.108652:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784583805.753395:0:9867:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784583806.128351:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784583806.629223:0:9920:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583806.630595:0:9920:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784583806.637963:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583806.637988:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054976:0@lo:41: 00000100:00100000:1.0:1784583806.638054:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583806.638286:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599054976 00000100:00100000:3.0:1784583806.638293:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599054976 00000100:00100000:3.0:1784583806.638342:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784583806.638351:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054976:12345-0@lo:41: 00000004:00000024:3.0:1784583806.638384:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784583806.638430:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599054976:12345-0@lo:41: Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583806.638438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784583806.638504:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599054976:0@lo:41: 00010000:00010000:0.0:1784583807.150810:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583808.173637:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583808.173661:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599055104:0@lo:13: 00010000:00010000:3.0:1784583808.173750:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583808.173773:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599055232:0@lo:13: 00000100:00100000:2.0:1784583808.173781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.173831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.173859:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055104 00000100:00100000:2.0:1784583808.173866:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055104 00000100:00100000:2.0:1784583808.173930:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055232 00000100:00100000:2.0:1784583808.173933:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055232 00000100:00100000:2.0:1784583808.173955:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784583808.173959:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583808.173965:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599055104:12345-0@lo:13: 00002000:00000024:2.0:1784583808.173993:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 10000000:01000000:1.0:1784583808.174034:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784583808.174039:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b43e967000 from 39 10000000:01000000:1.0:1784583808.174043:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1784583808.174047:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599055104:12345-0@lo:13: Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.174069:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784583808.174075:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.174095:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.174104:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583808.174118:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055360:0@lo:101: 00000100:00100000:1.0:1784583808.174151:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.174263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055360 00000100:00100000:0.0:1784583808.174268:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055360 00000100:00100000:0.0:1784583808.174300:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784583808.174307:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599055360:12345-0@lo:101: 00010000:00010000:0.0:1784583808.174316:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583808.174328:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4782c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.174347:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4782c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.174357:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4782c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.174373:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216aa00, rc 0) 00000100:00100000:0.0:1784583808.174401:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599055360:12345-0@lo:101: Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.174407:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784583808.174489:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784583808.174499:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599055232:12345-0@lo:13: 00000100:00100000:1.0:1784583808.174504:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ed80 going to sleep for 11 seconds 00002000:00000024:2.0:1784583808.174510:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583808.174526:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055360:0@lo:101: 00010000:00010000:1.0:1784583808.174542:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.174550:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599055232:12345-0@lo:13: Request processed in 51us (717us total) trans 0 rc 0/0 00010000:00010000:1.0:1784583808.174554:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.174560:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1784583808.174601:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eadf800 x1871271599055232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.174618:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599055232:0@lo:13: 00000100:00100000:1.0:1784583808.174628:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055488:0@lo:501: 00000100:00100000:1.0:1784583808.174660:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.174685:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.174692:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055488 00000100:00100000:2.0:1784583808.174697:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055488 00000100:00100000:2.0:1784583808.174724:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784583808.174732:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599055488:12345-0@lo:501: 00010000:00080000:3.0:1784583808.174805:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44000 x1871271599055104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583808.174821:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599055104:0@lo:13: 00000100:00100000:2.0:1784583808.174863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599055488:12345-0@lo:501: Request processed in 131us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.174870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784583808.174891:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055488:0@lo:501: 00000100:00100000:1.0:1784583808.174921:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055616:0@lo:503: 00000100:00100000:1.0:1784583808.174957:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.174977:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.176205:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055616 00000100:00100000:2.0:1784583808.176215:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055616 00000100:00100000:2.0:1784583808.176263:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784583808.176271:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599055616:12345-0@lo:503: 00000100:00100000:2.0:1784583808.176398:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599055616:12345-0@lo:503: Request processed in 128us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.176405:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784583808.176723:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599055616:0@lo:503: 00000100:00100000:1.0:1784583808.179557:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9972:1871271599055744:0@lo:502: 00000100:00100000:1.0:1784583808.179670:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.179721:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.179840:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055744 00000100:00100000:3.0:1784583808.179853:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055744 00000100:00100000:3.0:1784583808.179893:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784583808.179901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9972:x1871271599055744:12345-0@lo:502: 00000100:00100000:3.0:1784583808.180030:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9972:x1871271599055744:12345-0@lo:502: Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.180037:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784583808.180125:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9972:1871271599055744:0@lo:502: 00000100:00100000:1.0:1784583808.180166:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9972:1871271599055872:0@lo:502: 00000100:00100000:1.0:1784583808.180195:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.180218:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.180418:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599055872 00000100:00100000:3.0:1784583808.180423:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599055872 00000100:00100000:3.0:1784583808.180453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784583808.180460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9972:x1871271599055872:12345-0@lo:502: 00000100:00100000:3.0:1784583808.180545:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:9972:x1871271599055872:12345-0@lo:502: Request processed in 85us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.180552:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784583808.180659:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9972:1871271599055872:0@lo:502: 00000040:00080000:1.0:1784583808.180680:0:9972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1784583808.180918:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1784583808.180940:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784583808.180949:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.180958:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583808.180966:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784583808.180969:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1784583808.180972:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784583808.180995:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.181002:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.181021:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.181033:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056000:0@lo:101: 00000100:00100000:3.0:1784583808.181060:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.181095:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.181270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056000 00000100:00100000:0.0:1784583808.181274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056000 00000100:00100000:0.0:1784583808.181310:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784583808.181318:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599056000:12345-0@lo:101: 00010000:00010000:0.0:1784583808.181325:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583808.181336:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4783a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.181356:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4783a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.181367:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4783a expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.181375:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a600, rc 0) 00000100:00100000:0.0:1784583808.181407:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056000:12345-0@lo:101: Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.181413:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784583808.181521:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056000:0@lo:101: 00010000:00010000:3.0:1784583808.181535:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.181543:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.181586:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056128:0@lo:501: 00000100:00100000:3.0:1784583808.181623:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.181642:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.181839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056128 00000100:00100000:1.0:1784583808.181844:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056128 00000100:00100000:1.0:1784583808.181878:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784583808.181884:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056128:12345-0@lo:501: 00000100:00100000:1.0:1784583808.181992:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056128:12345-0@lo:501: Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.181998:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784583808.182180:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056128:0@lo:501: 00000100:00100000:2.0:1784583808.182219:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056256:0@lo:503: 00000100:00100000:2.0:1784583808.182259:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.182283:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.182299:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056256 00000100:00100000:1.0:1784583808.182304:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056256 00000100:00100000:1.0:1784583808.182337:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784583808.182342:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056256:12345-0@lo:503: 00000100:00100000:1.0:1784583808.182421:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056256:12345-0@lo:503: Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.182428:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784583808.182813:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056256:0@lo:503: 00000100:00100000:0.0:1784583808.183364:0:9973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9973:1871271599056384:0@lo:502: 00000100:00100000:0.0:1784583808.183408:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.183445:0:9973:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.183643:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056384 00000100:00100000:2.0:1784583808.183931:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056384 00000100:00100000:2.0:1784583808.183977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784583808.183984:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9973:x1871271599056384:12345-0@lo:502: 00000100:00100000:2.0:1784583808.184105:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9973:x1871271599056384:12345-0@lo:502: Request processed in 121us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.184112:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784583808.184290:0:9973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9973:1871271599056384:0@lo:502: 00000020:01000000:0.0:1784583808.184314:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583808.184322:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583808.184325:0:9973:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784583808.184328:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784583808.184330:0:9973:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784583808.184347:0:9973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9973:1871271599056512:0@lo:502: 00000100:00100000:0.0:1784583808.184379:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.184408:0:9973:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.184500:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056512 00000100:00100000:3.0:1784583808.184505:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056512 00000100:00100000:3.0:1784583808.184534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784583808.184540:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9973:x1871271599056512:12345-0@lo:502: 00000100:00100000:3.0:1784583808.184623:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:9973:x1871271599056512:12345-0@lo:502: Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.184630:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784583808.185026:0:9973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9973:1871271599056512:0@lo:502: 00000020:01000000:0.0:1784583808.185044:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583808.185047:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583808.185049:0:9973:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784583808.185052:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784583808.185420:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784583808.185441:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784583808.185451:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.185461:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583808.185503:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784583808.185506:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b42ba2f000 from 39 10000000:01000000:2.0:1784583808.185509:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784583808.185536:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.185543:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.185551:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.185573:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056640:0@lo:101: 00000100:00100000:2.0:1784583808.185823:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.185856:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.185897:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056640 00000100:00100000:1.0:1784583808.185902:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056640 00000100:00100000:1.0:1784583808.185940:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784583808.185947:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599056640:12345-0@lo:101: 00010000:00010000:1.0:1784583808.185958:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583808.185969:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47848 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.185988:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47848 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.185996:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47848 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.186005:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982a00, rc 0) 00000100:00100000:1.0:1784583808.186042:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599056640:12345-0@lo:101: Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.186048:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784583808.186120:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056640:0@lo:101: 00010000:00010000:2.0:1784583808.186133:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.186141:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.186267:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056768:0@lo:501: 00000100:00100000:2.0:1784583808.186292:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.186304:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.186364:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056768 00000100:00100000:0.0:1784583808.186369:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056768 00000100:00100000:0.0:1784583808.186399:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784583808.186407:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599056768:12345-0@lo:501: 00000100:00100000:0.0:1784583808.186533:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599056768:12345-0@lo:501: Request processed in 126us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.186540:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784583808.186852:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056768:0@lo:501: 00000100:00100000:2.0:1784583808.186882:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056896:0@lo:503: 00000100:00100000:2.0:1784583808.186922:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.187027:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.189961:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599056896 00000100:00100000:1.0:1784583808.189975:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599056896 00000100:00100000:1.0:1784583808.190038:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784583808.190048:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599056896:12345-0@lo:503: 00000100:00100000:1.0:1784583808.190225:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599056896:12345-0@lo:503: Request processed in 178us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.190233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784583808.190281:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599056896:0@lo:503: 00000100:00100000:1.0:1784583808.191012:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9974:1871271599057024:0@lo:502: 00000100:00100000:1.0:1784583808.191062:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.191110:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.192624:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057024 00000100:00100000:3.0:1784583808.192637:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057024 00000100:00100000:3.0:1784583808.192700:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784583808.192709:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:9974:x1871271599057024:12345-0@lo:502: 00000100:00100000:3.0:1784583808.192879:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:9974:x1871271599057024:12345-0@lo:502: Request processed in 170us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.192886:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784583808.192995:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9974:1871271599057024:0@lo:502: 00000100:00100000:2.0:1784583808.193058:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9974:1871271599057152:0@lo:502: 00000100:00100000:2.0:1784583808.193138:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.193265:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.193348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057152 00000100:00100000:1.0:1784583808.193352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057152 00000100:00100000:1.0:1784583808.193423:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784583808.193432:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:9974:x1871271599057152:12345-0@lo:502: 00000100:00100000:1.0:1784583808.193552:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:9974:x1871271599057152:12345-0@lo:502: Request processed in 120us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.193559:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784583808.193643:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9974:1871271599057152:0@lo:502: 00000040:00080000:2.0:1784583808.193683:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784583808.193743:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784583808.193763:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784583808.193773:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.193783:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583808.193793:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784583808.193795:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b42ba2f000 from 6 10000000:01000000:2.0:1784583808.193798:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583808.193823:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.193831:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.193839:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.193851:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057280:0@lo:101: 00000100:00100000:2.0:1784583808.193879:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.194072:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.194236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057280 00000100:00100000:3.0:1784583808.194243:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057280 00000100:00100000:3.0:1784583808.194269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784583808.194275:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599057280:12345-0@lo:101: 00010000:00010000:3.0:1784583808.194283:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583808.194295:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97400/0xdab2421a42e4785d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47856 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.194314:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97400/0xdab2421a42e4785d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47856 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.194324:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97400/0xdab2421a42e4785d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47856 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.194332:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97400, rc 0) 00000100:00100000:3.0:1784583808.194409:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599057280:12345-0@lo:101: Request processed in 133us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.194415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784583808.194569:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057280:0@lo:101: 00010000:00010000:2.0:1784583808.194581:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.194590:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.194644:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057408:0@lo:256: 00000100:00100000:2.0:1784583808.194724:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.194787:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.194820:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057408 00000100:00100000:3.0:1784583808.194825:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057408 00000100:00100000:3.0:1784583808.194879:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784583808.194887:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599057408:12345-0@lo:256: 20000000:01000000:3.0:1784583808.194901:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784583808.194917:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784583808.194920:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1784583808.195008:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599057408:12345-0@lo:256: Request processed in 122us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.195015:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784583808.195067:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057408:0@lo:256: 10000000:01000000:1.0:1784583808.195118:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784583808.195124:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.195131:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583808.195140:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784583808.195142:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1784583808.195144:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784583808.195160:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.195166:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.195193:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583808.195204:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057536:0@lo:101: 00000100:00100000:1.0:1784583808.195230:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.195370:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.195549:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057536 00000100:00100000:2.0:1784583808.195554:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057536 00000100:00100000:2.0:1784583808.195576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784583808.195583:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599057536:12345-0@lo:101: 00010000:00010000:2.0:1784583808.195590:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583808.195601:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47864 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.195616:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47864 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.195624:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47864 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.195631:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583808.195671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599057536:12345-0@lo:101: Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.195678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784583808.195856:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057536:0@lo:101: 00010000:00010000:1.0:1784583808.195867:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583808.195875:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583808.195925:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057664:0@lo:501: 00000100:00100000:1.0:1784583808.195948:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.196002:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.196030:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057664 00000100:00100000:2.0:1784583808.196034:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057664 00000100:00100000:2.0:1784583808.196103:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784583808.196110:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599057664:12345-0@lo:501: 00000100:00100000:2.0:1784583808.196287:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599057664:12345-0@lo:501: Request processed in 177us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.196305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784583808.196359:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057664:0@lo:501: 00000100:00100000:1.0:1784583808.196386:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057792:0@lo:503: 00000100:00100000:1.0:1784583808.196422:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.196507:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.196637:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057792 00000100:00100000:3.0:1784583808.196641:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057792 00000100:00100000:3.0:1784583808.196719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784583808.196725:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599057792:12345-0@lo:503: 00000100:00100000:3.0:1784583808.196807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599057792:12345-0@lo:503: Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.196814:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784583808.196881:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599057792:0@lo:503: 00000100:00100000:1.0:1784583808.197217:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9975:1871271599057920:0@lo:502: 00000100:00100000:1.0:1784583808.197253:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.197276:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.198069:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599057920 00000100:00100000:2.0:1784583808.198077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599057920 00000100:00100000:2.0:1784583808.198126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784583808.198133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:9975:x1871271599057920:12345-0@lo:502: 00000100:00100000:2.0:1784583808.198241:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:9975:x1871271599057920:12345-0@lo:502: Request processed in 108us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.198249:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784583808.198532:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9975:1871271599057920:0@lo:502: 00000020:01000000:1.0:1784583808.198575:0:9975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784583808.198582:0:9975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784583808.198589:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583808.198592:0:9975:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784583808.198981:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784583808.198987:0:9975:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1784583808.199008:0:9975:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784583808.199011:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784583808.199025:0:9975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98b302a4cd40) 00000020:00000080:1.0:1784583808.199049:0:9975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784583808.199054:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784583808.199157:0:9975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784583808.199164:0:9975:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784583808.199171:0:9975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e47879 00010000:00080000:1.0:1784583808.199199:0:9975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302bd4000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784583808.200289:0:9975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1784583808.200523:0:9975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784583808.200548:0:9975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784583808.200745:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784583808.201127:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784583808.201279:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784583808.201361:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1784583808.202385:0:9976:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583808.202390:0:9976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784583808.203101:0:9975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784583808.203114:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784583808.203153:0:9975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784583808.203191:0:9975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e47880 00000100:00080000:3.0:1784583808.203203:0:9975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784583808.203209:0:9975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd4000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784583808.203246:0:9975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43eaddf80 x1871271599058048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784583808.203276:0:9975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784583808.203337:0:9975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583808.203352:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583808.203354:0:9975:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784583808.203358:0:9975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583808.203363:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583808.203364:0:9975:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784583808.203367:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784583808.203369:0:9975:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784583808.203394:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9975:1871271599058176:0@lo:502: 00000100:00100000:3.0:1784583808.203491:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.203534:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.203554:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058176 00000100:00100000:3.0:1784583808.203560:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058176 00000100:00100000:3.0:1784583808.203597:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784583808.203605:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:9975:x1871271599058176:12345-0@lo:502: 00000100:00100000:3.0:1784583808.203728:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:9975:x1871271599058176:12345-0@lo:502: Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.203736:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784583808.203750:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599058048:0@lo:8: 00000100:00100000:0.0:1784583808.203781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.203783:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9975:1871271599058176:0@lo:502: 00000020:01000000:3.0:1784583808.203805:0:9975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583808.203809:0:9975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583808.203810:0:9975:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784583808.203813:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1784583808.203921:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1784583808.203943:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784583808.203952:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.203972:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583808.203982:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784583808.203984:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b418942800 from 39 10000000:01000000:0.0:1784583808.203987:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784583808.204009:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.204017:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.204025:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583808.204037:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599058304:0@lo:101: 00000100:00100000:0.0:1784583808.204064:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.204095:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.204360:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058304 00000100:00100000:3.0:1784583808.204364:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058304 00000100:00100000:3.0:1784583808.204397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784583808.204404:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599058304:12345-0@lo:101: 00010000:00010000:3.0:1784583808.204413:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583808.204424:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47887 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.204443:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47887 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.204452:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47887 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.204460:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96000, rc 0) 00000100:00100000:3.0:1784583808.204512:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599058304:12345-0@lo:101: Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.204525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784583808.204645:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599058304:0@lo:101: 00010000:00010000:0.0:1784583808.204658:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.204667:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583808.204711:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599058560:0@lo:501: 00000100:00100000:0.0:1784583808.204736:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.204760:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.204771:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599058816:0@lo:400: 00000100:00100000:0.0:1784583808.204796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.204823:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599059328:0@lo:400: 00000100:00100000:1.0:1784583808.204968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058816 00000100:00100000:1.0:1784583808.204973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058816 00000100:00100000:1.0:1784583808.205001:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583808.205008:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599058816:12345-0@lo:400: 00000100:00100000:1.0:1784583808.205041:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599058816:12345-0@lo:400: Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.205056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784583808.205098:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599058432:0@lo:400: 00000100:00100000:3.0:1784583808.205124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.205151:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599059072:0@lo:400: 00000100:00100000:0.0:1784583808.205165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784583808.205192:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303851180 x1871271599058816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.205202:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599058816:0@lo:400: 00000100:00100000:0.0:1784583808.205216:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784583808.205222:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599058688:0@lo:400: 00000100:00100000:1.0:1784583808.205248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058432 00000100:00100000:0.0:1784583808.205250:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.205251:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058432 00000100:00100000:0.0:1784583808.205267:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599059200:0@lo:400: 00000100:00100000:1.0:1784583808.205271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059328 00000100:00100000:1.0:1784583808.205273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059328 00000100:00100000:0.0:1784583808.205288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.205291:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059200 00000100:00100000:1.0:1784583808.205293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059200 00000100:00100000:1.0:1784583808.205307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583808.205313:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599058432:12345-0@lo:400: 00000100:00100000:1.0:1784583808.205355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599058432:12345-0@lo:400: Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.205362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583808.205373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784583808.205379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599059328:12345-0@lo:400: 00000100:00100000:1.0:1784583808.205414:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599059328:12345-0@lo:400: Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.205420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784583808.205430:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784583808.205435:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599059200:12345-0@lo:400: 00000100:00100000:1.0:1784583808.205458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599059200:12345-0@lo:400: Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.205464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784583808.205595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784583808.205630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303851f80 x1871271599058432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583808.205640:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599058432:0@lo:400: 00000100:00100000:3.0:1784583808.205827:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784583808.205837:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599058944:0@lo:400: 00000100:00100000:3.0:1784583808.205862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.205883:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599059456:0@lo:400: 00000100:00100000:3.0:1784583808.205902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.205927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058688 00000100:00100000:3.0:1784583808.205931:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058688 00000100:00100000:3.0:1784583808.205949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058944 00000100:00100000:3.0:1784583808.205952:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058944 00000100:00100000:3.0:1784583808.205965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784583808.205972:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599058688:12345-0@lo:400: 00000100:00100000:3.0:1784583808.206005:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599058688:12345-0@lo:400: Request processed in 33us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.206011:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784583808.206022:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599058688:0@lo:400: 00000100:00100000:3.0:1784583808.206023:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784583808.206029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599058944:12345-0@lo:400: 00010000:00080000:0.0:1784583808.206033:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303852a00 x1871271599059200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.206041:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599059200:0@lo:400: 00010000:00080000:0.0:1784583808.206050:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303851c00 x1871271599059328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.206058:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599059328:0@lo:400: 00000100:00100000:3.0:1784583808.206059:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599058944:12345-0@lo:400: Request processed in 31us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.206072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1784583808.206102:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583808.206106:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583808.206114:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059072 00000100:00100000:3.0:1784583808.206118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059072 00000100:00100000:3.0:1784583808.206149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059456 00000100:00100000:3.0:1784583808.206152:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059456 00000100:00100000:3.0:1784583808.206166:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1784583808.206209:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583808.206213:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583808.206446:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058048 00000100:00100000:2.0:1784583808.206452:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058048 00000100:00100000:2.0:1784583808.206493:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784583808.206499:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1871271599058048:12345-0@lo:8: 00010000:00080000:2.0:1784583808.206524:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1784583808.206550:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e47895 00002000:00100000:2.0:1784583808.206563:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98b302718800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784583808.206567:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1784583808.206570:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784583808.206628:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784583808.207451:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784583808.207497:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b302719800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583808.207561:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599058048:12345-0@lo:8: Request processed in 1059us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.207569:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1784583808.207689:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eaddf80 x1871271599058048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784583818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.207699:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784583808.207713:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784583808.207721:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784583808.207726:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784583808.207728:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784583808.207742:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784583808.207747:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599058048:0@lo:8: 00000004:00080000:1.0:1784583808.207749:0:9976:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784583808.207800:0:9976:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 251393331768ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784583808.207807:0:9976:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1784583808.208153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599059072:12345-0@lo:400: 00000100:00100000:3.0:1784583808.208199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599059072:12345-0@lo:400: Request processed in 53us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.208910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583808.208924:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599059456:12345-0@lo:400: 00000100:00100000:2.0:1784583808.208968:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599059456:12345-0@lo:400: Request processed in 49us (3064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.208983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583808.209029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599058560 00000100:00100000:2.0:1784583808.209035:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599058560 00000100:00100000:2.0:1784583808.209067:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784583808.209072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599058560:12345-0@lo:501: 00000100:00100000:2.0:1784583808.209190:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599058560:12345-0@lo:501: Request processed in 116us (4452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.209196:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784583808.209301:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599058560:0@lo:501: 00000100:00100000:0.0:1784583808.209343:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599059584:0@lo:503: 00000100:00100000:0.0:1784583808.209387:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.209424:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.210858:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059584 00000100:00100000:2.0:1784583808.210870:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059584 00000100:00100000:2.0:1784583808.210912:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784583808.210919:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599059584:12345-0@lo:503: 00000100:00100000:2.0:1784583808.211034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599059584:12345-0@lo:503: Request processed in 115us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.211042:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784583808.211190:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599059584:0@lo:503: 00000100:00100000:2.0:1784583808.212235:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9978:1871271599059712:0@lo:502: 00000100:00100000:2.0:1784583808.212293:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.212320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059712 00000100:00100000:2.0:1784583808.212325:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059712 00000100:00100000:2.0:1784583808.212356:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784583808.212363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:9978:x1871271599059712:12345-0@lo:502: 00000100:00100000:2.0:1784583808.212485:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:9978:x1871271599059712:12345-0@lo:502: Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.212493:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784583808.212530:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.212548:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9978:1871271599059712:0@lo:502: 00000100:00100000:2.0:1784583808.212595:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9978:1871271599059840:0@lo:502: 00000100:00100000:2.0:1784583808.212633:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.213162:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059840 00000100:00100000:2.0:1784583808.213169:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059840 00000100:00100000:2.0:1784583808.213198:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784583808.213205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:9978:x1871271599059840:12345-0@lo:502: 00000100:00100000:2.0:1784583808.213280:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:9978:x1871271599059840:12345-0@lo:502: Request processed in 75us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.213287:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784583808.213320:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.213336:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9978:1871271599059840:0@lo:502: 00000040:00080000:2.0:1784583808.213358:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784583808.213415:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784583808.213816:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784583808.213826:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.213838:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583808.213848:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784583808.213851:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b418942800 from 6 10000000:01000000:2.0:1784583808.213854:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784583808.213880:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.213888:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.213912:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.213927:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599059968:0@lo:101: 00000100:00100000:2.0:1784583808.213962:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.213981:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.215409:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599060096:0@lo:700: 00000100:00100000:1.0:1784583808.215462:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.215524:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060096 00000100:00100000:1.0:1784583808.215530:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060096 00000100:00100000:1.0:1784583808.215574:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784583808.215584:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9977:x1871271599060096:12345-0@lo:700: 00000100:00100000:1.0:1784583808.215617:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1871271599060224:0@lo:700: 00000100:00100000:1.0:1784583808.215654:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.216517:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.216541:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7540 going to sleep for 11 seconds 00000100:00080000:0.0:1784583808.217246:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583808.217275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060224 00000100:00100000:0.0:1784583808.217284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060224 00000100:00100000:0.0:1784583808.217335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784583808.217345:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1871271599060224:12345-0@lo:700: 00000100:00100000:0.0:1784583808.217494:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599059968 00000100:00100000:0.0:1784583808.217499:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599059968 00000100:00100000:0.0:1784583808.217527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784583808.217533:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599059968:12345-0@lo:101: 00010000:00010000:0.0:1784583808.217542:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583808.217561:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216a200/0xdab2421a42e478a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4789c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.217584:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216a200/0xdab2421a42e478a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4789c expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.217611:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216a200/0xdab2421a42e478a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4789c expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.217619:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a200, rc 0) 00000100:00100000:0.0:1784583808.217692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599059968:12345-0@lo:101: Request processed in 158us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.217699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:1.0:1784583808.218178:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784583808.219031:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599059968:0@lo:101: 00010000:00010000:2.0:1784583808.219055:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.219068:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.219199:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060352:0@lo:256: 00000100:00100000:2.0:1784583808.219253:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.219296:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.219326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060352 00000100:00100000:0.0:1784583808.219333:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060352 00000100:00100000:0.0:1784583808.219382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784583808.219390:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599060352:12345-0@lo:256: 20000000:01000000:0.0:1784583808.219407:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784583808.219423:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784583808.219426:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784583808.219532:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599060352:12345-0@lo:256: Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.219538:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784583808.219660:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060352:0@lo:256: 00000100:00100000:3.0:1784583808.219693:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 10000000:01000000:2.0:1784583808.219706:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784583808.219713:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.219722:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583808.219730:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784583808.219732:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 00000100:00100000:3.0:1784583808.219735:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599058944:0@lo:400: 10000000:01000000:2.0:1784583808.219740:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00080000:3.0:1784583808.219750:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303850380 x1871271599059456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583808.219759:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599059456:0@lo:400: 00010000:00010000:2.0:1784583808.219761:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.219768:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784583808.219769:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303850a80 x1871271599059072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583808.219778:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599059072:0@lo:400: 00010000:00010000:2.0:1784583808.219778:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583808.219789:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060480:0@lo:101: 00000100:00100000:2.0:1784583808.219813:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.219842:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.220187:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060480 00000100:00100000:0.0:1784583808.220193:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060480 00000100:00100000:0.0:1784583808.220229:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784583808.220237:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599060480:12345-0@lo:101: 00010000:00010000:0.0:1784583808.220247:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583808.220260:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e478aa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.220282:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e478aa expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.220303:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e478aa expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583808.220311:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a400, rc 0) 00000100:00100000:0.0:1784583808.220352:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599060480:12345-0@lo:101: Request processed in 116us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.220359:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784583808.220644:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060480:0@lo:101: 00010000:00010000:3.0:1784583808.220916:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.220925:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.221003:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060608:0@lo:501: 00000100:00100000:3.0:1784583808.221035:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.221124:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3600 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.227201:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060608 00000100:00100000:1.0:1784583808.227216:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060608 00000100:00100000:1.0:1784583808.227268:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784583808.227278:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599060608:12345-0@lo:501: 00000100:00100000:1.0:1784583808.227720:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599060608:12345-0@lo:501: Request processed in 441us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.227729:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784583808.228174:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060608:0@lo:501: 00000100:00100000:3.0:1784583808.228223:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060736:0@lo:503: 00000100:00100000:3.0:1784583808.228281:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.228360:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3600 going to sleep for 11 seconds 40000000:02000000:3.0:1784583808.229147:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1784583808.229622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060736 00000100:00100000:2.0:1784583808.229633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060736 00000100:00100000:2.0:1784583808.229682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784583808.229692:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599060736:12345-0@lo:503: 00000100:00100000:2.0:1784583808.229822:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599060736:12345-0@lo:503: Request processed in 132us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.229830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784583808.231716:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599060736:0@lo:503: 00000100:00100000:2.0:1784583808.231909:0:9979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9979:1871271599060864:0@lo:502: 00000100:00100000:2.0:1784583808.231975:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.232002:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060864 00000100:00100000:2.0:1784583808.232007:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060864 00000100:00100000:2.0:1784583808.232035:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784583808.232041:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:9979:x1871271599060864:12345-0@lo:502: 00000100:00100000:2.0:1784583808.232143:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:9979:x1871271599060864:12345-0@lo:502: Request processed in 101us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.232156:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784583808.232196:0:9979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.232208:0:9979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9979:1871271599060864:0@lo:502: 00000020:01000000:2.0:1784583808.232229:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784583808.232236:0:9979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784583808.232244:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583808.232246:0:9979:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784583808.232251:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784583808.232255:0:9979:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:2.0:1784583808.232276:0:9979:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784583808.232278:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784583808.232291:0:9979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98b4071ab380) 00000020:00000080:2.0:1784583808.232313:0:9979:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1784583808.232318:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784583808.232403:0:9979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784583808.232409:0:9979:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784583808.232415:0:9979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e478bf 00010000:00080000:2.0:1784583808.237063:0:9979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b303a97800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784583808.237324:0:9979:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1784583808.237492:0:9979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784583808.237505:0:9979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784583808.240760:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583808.240902:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784583808.241064:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784583808.241165:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1784583808.244631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1871271599060224:12345-0@lo:700: Request processed in 27280us (28969us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.244645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784583808.244852:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303851c00 x1871271599060224/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.244867:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1871271599060224:0@lo:700: 40000000:02000000:0.0:1784583808.244879:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1784583808.250745:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583808.250756:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784583808.252062:0:9979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784583808.252075:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784583808.252119:0:9979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784583808.252145:0:9979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e478c6 00000100:00080000:1.0:1784583808.252155:0:9979:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784583808.252161:0:9979:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b303a97800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583808.252196:0:9979:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303853b80 x1871271599060992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784583808.252227:0:9979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784583808.252306:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583808.252317:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583808.252319:0:9979:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784583808.252324:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583808.252328:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583808.252329:0:9979:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784583808.252332:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784583808.252334:0:9979:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784583808.252369:0:9979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9979:1871271599061120:0@lo:502: 00000100:00100000:1.0:1784583808.252451:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.252501:0:9979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.252643:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599060992:0@lo:8: 00000100:00100000:3.0:1784583808.252694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.252749:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599060992 00000100:00100000:1.0:1784583808.252756:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599060992 00000100:00100000:1.0:1784583808.252795:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784583808.252802:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599060992:12345-0@lo:8: 00010000:00080000:1.0:1784583808.252825:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1784583808.252847:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e478cd 00002000:00100000:1.0:1784583808.252859:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98b42f7dc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784583808.252863:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784583808.252866:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784583808.252930:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784583808.252949:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98b42f7d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583808.252994:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599060992:12345-0@lo:8: Request processed in 191us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583808.253002:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1784583808.253096:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303853b80 x1871271599060992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784583818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583808.253107:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784583808.253114:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784583808.253121:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784583808.253125:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784583808.253128:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b303a97800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784583808.253144:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784583808.253149:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599060992:0@lo:8: 00000004:00080000:1.0:1784583808.253172:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784583808.253221:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251438752715ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784583808.253227:0:9980:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784583808.253285:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061120 00000100:00100000:2.0:1784583808.253290:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061120 00000100:00100000:2.0:1784583808.253320:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784583808.253328:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:9979:x1871271599061120:12345-0@lo:502: 00000100:00100000:2.0:1784583808.254282:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:9979:x1871271599061120:12345-0@lo:502: Request processed in 950us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.254293:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784583808.254689:0:9979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:9979:1871271599061120:0@lo:502: 00000020:01000000:1.0:1784583808.254720:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583808.254731:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583808.254732:0:9979:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784583808.254738:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1784583808.254904:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1784583808.255000:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784583808.255009:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.255020:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583808.258570:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784583808.258581:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b4331acd40 from 1 10000000:01000000:3.0:1784583808.258608:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784583808.258662:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.258676:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.258688:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.258715:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599061248:0@lo:101: 00000100:00100000:3.0:1784583808.258787:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.258849:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.259013:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061248 00000100:00100000:2.0:1784583808.259022:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061248 00000100:00100000:2.0:1784583808.259074:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784583808.259403:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599061248:12345-0@lo:101: 00010000:00010000:2.0:1784583808.259420:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1784583808.261626:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1784583808.262426:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784583808.262445:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1784583808.262700:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e478d4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.262721:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599060096:12345-0@lo:700: Request processed in 47135us (47253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.262733:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784583808.262737:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.262752:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583808.262762:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784583808.262806:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599061248:12345-0@lo:101: Request processed in 3724us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.262813:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784583808.262933:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599061248:0@lo:101: 00010000:00010000:3.0:1784583808.262952:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.262963:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583808.263028:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599061376:0@lo:501: 00000100:00100000:3.0:1784583808.263058:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.263096:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.263219:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061376 00000100:00100000:2.0:1784583808.263226:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061376 00000100:00100000:2.0:1784583808.263255:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784583808.263264:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599061376:12345-0@lo:501: 00000100:00100000:2.0:1784583808.263346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599061376:12345-0@lo:501: Request processed in 83us (286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784583808.263354:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784583808.263653:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599061376:0@lo:501: 10000000:01000000:3.0:1784583808.263680:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784583808.263704:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583808.263712:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784583808.263964:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303852300 x1871271599060096/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583808.263977:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599060096:0@lo:700: 00000004:00080000:0.0:1784583808.267948:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784583808.267981:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061632:0@lo:7: 00000100:00100000:0.0:1784583808.268047:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.268094:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583808.268145:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583808.268146:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061632 00000100:00100000:1.0:1784583808.268156:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061632 00000100:00100000:2.0:1784583808.268162:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599061504:0@lo:13: 00000100:00100000:2.0:1784583808.268199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583808.268230:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784583808.268233:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061504 00000100:00100000:2.0:1784583808.268239:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061504 00000100:00100000:1.0:1784583808.268241:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1871271599061632:12345-0@lo:7: 00000100:00100000:2.0:1784583808.268272:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784583808.268281:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599061504:12345-0@lo:13: 00002000:00000024:2.0:1784583808.268301:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1784583808.268344:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599061504:12345-0@lo:13: Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583808.268351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784583808.268394:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427b80 x1871271599061504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.268412:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599061504:0@lo:13: 00000100:00080000:0.0:1784583808.268495:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1784583808.275320:0:8805:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1784583808.275330:0:8805:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784583808.275435:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1871271599061632:12345-0@lo:7: Request processed in 7193us (7384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.275446:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784583808.275528:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427800 x1871271599061632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.275545:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061632:0@lo:7: 00000004:00080000:2.0:1784583808.275571:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784583808.275610:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061760:0@lo:5: 00000100:00100000:2.0:1784583808.275663:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.275693:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a313000 going to sleep for 11 seconds 00000100:00100000:1.0:1784583808.276872:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061760 00000100:00100000:1.0:1784583808.276883:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061760 00000100:00100000:1.0:1784583808.276938:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784583808.276947:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9981:x1871271599061760:12345-0@lo:5: 00002000:00080000:1.0:1784583808.276975:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784583808.276979:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784583808.277280:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9981:x1871271599061760:12345-0@lo:5: Request processed in 333us (1615us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784583808.277287:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1784583808.279888:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44a80 x1871271599061760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.279908:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061760:0@lo:5: 00000004:00080000:2.0:1784583808.279922:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784583808.279963:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061888:0@lo:700: 00000100:00100000:2.0:1784583808.280014:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.280048:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a313000 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.280125:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599061888 00000100:00100000:0.0:1784583808.280132:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599061888 00000100:00100000:0.0:1784583808.280268:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784583808.280288:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9981:x1871271599061888:12345-0@lo:700: 00000001:00080000:3.0:1784583808.284903:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:00080000:2.0:1784583808.285073:0:9977:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784583808.285113:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062144:0@lo:7: 00000100:00100000:1.0:1784583808.285118:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583808.285136:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599062016:0@lo:13: 00000100:00100000:0.0:1784583808.285260:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9981:x1871271599061888:12345-0@lo:700: Request processed in 4972us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.285274:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784583808.285278:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.285354:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a313780 going to sleep for 11 seconds 00010000:00080000:2.0:1784583808.285385:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44700 x1871271599061888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.285397:0:9981:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784583808.285412:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599061888:0@lo:700: 00000100:00100000:3.0:1784583808.285751:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062144 00000100:00100000:3.0:1784583808.285758:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062144 00000100:00100000:3.0:1784583808.285848:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784583808.285859:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599062144:12345-0@lo:7: 00000100:00100000:1.0:1784583808.288593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.288682:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062016 00000100:00100000:0.0:1784583808.288690:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062016 00000100:00100000:0.0:1784583808.288739:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784583808.288750:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599062016:12345-0@lo:13: 00002000:00000024:0.0:1784583808.288773:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1784583808.288840:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599062016:12345-0@lo:13: Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.288848:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1784583808.289266:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b46a00 x1871271599062016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583808.289286:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599062016:0@lo:13: 00000004:02000040:0.0:1784583808.289675:0:9981:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:3.0:1784583808.291887:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1784583808.291895:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784583808.292585:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599062144:12345-0@lo:7: Request processed in 6723us (7307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.292598:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784583808.292798:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44000 x1871271599062144/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.292813:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062144:0@lo:7: 00000004:00080000:2.0:1784583808.292893:0:9977:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784583808.292934:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062272:0@lo:5: 00000100:00100000:2.0:1784583808.292971:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.293031:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a313780 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.293079:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062272 00000100:00100000:3.0:1784583808.293095:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062272 00000100:00100000:3.0:1784583808.293139:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784583808.293148:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599062272:12345-0@lo:5: 00002000:00080000:3.0:1784583808.293172:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1784583808.293249:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599062272:12345-0@lo:5: Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.293256:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784583808.293298:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427b80 x1871271599062272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.293308:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062272:0@lo:5: 00000004:00080000:2.0:1784583808.293317:0:9977:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784583808.293340:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062400:0@lo:5: 00000100:00100000:2.0:1784583808.293361:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583808.293413:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a313780 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.293521:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062400 00000100:00100000:3.0:1784583808.293526:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062400 00000100:00100000:3.0:1784583808.293659:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583808.293668:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9977:x1871271599062400:12345-0@lo:5: 00002000:00080000:3.0:1784583808.293692:0:8805:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1784583808.294760:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599062528:0@lo:5: 00000100:00100000:0.0:1784583808.294817:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.295835:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1000 going to sleep for 11 seconds 00000100:00100000:3.0:1784583808.297039:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9977:x1871271599062400:12345-0@lo:5: Request processed in 3369us (3673us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784583808.297050:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1784583808.297190:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b46a00 x1871271599062400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.297208:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1871271599062400:0@lo:5: 00000004:00080000:0.0:1784583808.297221:0:9977:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1784583808.297257:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1871271599062656:0@lo:900: 00000100:00100000:0.0:1784583808.297292:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583808.297312:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583808.297331:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062656 00000100:00100000:0.0:1784583808.297336:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062656 00000100:00100000:0.0:1784583808.297378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784583808.297394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1871271599062656:12345-0@lo:900: 00000100:00100000:0.0:1784583808.297446:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1871271599062656:12345-0@lo:900: Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583808.297453:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784583808.297502:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aaf480 x1871271599062656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583808.297512:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1871271599062656:0@lo:900: 00000100:00100000:1.0:1784583808.299170:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062528 00000100:00100000:1.0:1784583808.299182:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062528 00000100:00100000:1.0:1784583808.299302:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784583808.299324:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9981:x1871271599062528:12345-0@lo:5: 00002000:00080000:0.0:1784583808.313537:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1784583808.313561:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1784583808.315338:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9981:x1871271599062528:12345-0@lo:5: Request processed in 16010us (20514us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784583808.315351:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784583808.315375:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b404956d80 x1871271599062528/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784583824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583808.315392:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1871271599062528:0@lo:5: 00000004:00080000:2.0:1784583808.315406:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:0.0:1784583808.398958:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1784583808.398977:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1784583808.685604:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583808.685629:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599062784:0@lo:41: 00000100:00100000:3.0:1784583808.685688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583808.685743:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062784 00000100:00100000:3.0:1784583808.685749:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062784 00000100:00100000:3.0:1784583808.685909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784583808.685917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599062784:12345-0@lo:41: 00000004:00000024:3.0:1784583808.685947:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784583808.685985:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599062784:12345-0@lo:41: Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583808.685991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784583808.686043:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599062784:0@lo:41: 00000020:00000004:0.0:1784583809.144902:0:10031:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784583809.145144:0:10031:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784583809.197893:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784583809.915692:0:10079:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784583809.915702:0:10079:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1784583810.222823:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583810.425823:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.425893:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580139648 00000100:00100000:2.0:1784583810.425903:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580139648 00000100:00100000:2.0:1784583810.425953:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 179 00000100:00100000:2.0:1784583810.425962:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1871271580139648:12345-192.168.203.51@tcp:250: 00010000:00080000:2.0:1784583810.425998:0:6508:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d0d05096-428d-430e-97a4-2faca82157e3@192.168.203.51@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1784583810.426026:0:6508:0:(genops.c:1406:class_connect()) connect: client d0d05096-428d-430e-97a4-2faca82157e3, cookie 0xdab2421a42e478e2 00000100:00080000:2.0:1784583810.426161:0:6508:0:(import.c:65:import_set_state_nolock()) ffff98b303a97000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583810.426228:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+5:2397:x1871271580139648:12345-192.168.203.51@tcp:250: Request processed in 266us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.426236:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 179 00000100:00100000:2.0:1784583810.438187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.438300:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580139776 00000100:00100000:0.0:1784583810.438310:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580139776 00000100:00100000:0.0:1784583810.438364:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:0.0:1784583810.438374:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+5:6156:x1871271580139776:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1784583810.438391:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583810.438408:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee128 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.438435:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.438462:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.438528:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1da00, rc 0) 00000100:00100000:0.0:1784583810.438577:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+6:6156:x1871271580139776:12345-192.168.203.51@tcp:101: Request processed in 204us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.438584:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:1.0:1784583810.447367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.447545:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580139904 00000100:00100000:0.0:1784583810.447554:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580139904 00000100:00100000:0.0:1784583810.447656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:0.0:1784583810.447666:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+6:6156:x1871271580139904:12345-192.168.203.51@tcp:501: 00000100:00100000:0.0:1784583810.448098:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+6:6156:x1871271580139904:12345-192.168.203.51@tcp:501: Request processed in 432us (737us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784583810.448108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:1.0:1784583810.459391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.459530:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140032 00000100:00100000:2.0:1784583810.459540:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140032 00000100:00100000:2.0:1784583810.459593:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:2.0:1784583810.459616:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+6:6156:x1871271580140032:12345-192.168.203.51@tcp:101: 00010000:00010000:2.0:1784583810.459632:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583810.459658:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee12f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.459699:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.459712:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.459721:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784583810.459960:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+7:6156:x1871271580140032:12345-192.168.203.51@tcp:101: Request processed in 345us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.459966:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:1.0:1784583810.467444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.467616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140160 00000100:00100000:0.0:1784583810.467626:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140160 00000100:00100000:0.0:1784583810.467700:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:0.0:1784583810.467711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+7:6156:x1871271580140160:12345-192.168.203.51@tcp:501: 00000100:00100000:0.0:1784583810.467968:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+8:6156:x1871271580140160:12345-192.168.203.51@tcp:501: Request processed in 259us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.467976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:1.0:1784583810.473360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.473833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140288 00000100:00100000:0.0:1784583810.473843:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140288 00000100:00100000:0.0:1784583810.473910:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:0.0:1784583810.473921:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+8:6156:x1871271580140288:12345-192.168.203.51@tcp:503: 00000100:00100000:0.0:1784583810.474308:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+8:6156:x1871271580140288:12345-192.168.203.51@tcp:503: Request processed in 388us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.474317:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:1.0:1784583810.481049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.481776:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140416 00000100:00100000:2.0:1784583810.481786:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140416 00000100:00100000:2.0:1784583810.481892:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:2.0:1784583810.481903:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+8:6175:x1871271580140416:12345-192.168.203.51@tcp:502: 00000100:00100000:2.0:1784583810.482079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+8:6175:x1871271580140416:12345-192.168.203.51@tcp:502: Request processed in 167us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.482088:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:1.0:1784583810.532440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.532714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140544 00000100:00100000:0.0:1784583810.532724:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140544 00000100:00100000:0.0:1784583810.532784:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00100000:0.0:1784583810.532795:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+8:6175:x1871271580140544:12345-192.168.203.51@tcp:502: 00000100:00100000:0.0:1784583810.532954:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+8:6175:x1871271580140544:12345-192.168.203.51@tcp:502: Request processed in 161us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.532962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00100000:1.0:1784583810.536279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.536373:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140672 00000100:00100000:2.0:1784583810.536384:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140672 00000100:00100000:2.0:1784583810.536455:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00100000:2.0:1784583810.536504:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+8:6156:x1871271580140672:12345-192.168.203.51@tcp:101: 00010000:00010000:2.0:1784583810.536520:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583810.536549:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e478f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee160 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.536586:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e478f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee160 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.536598:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e478f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee160 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583810.536608:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7bc00, rc 0) 00000100:00100000:2.0:1784583810.536651:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+9:6156:x1871271580140672:12345-192.168.203.51@tcp:101: Request processed in 187us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.536658:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00100000:1.0:1784583810.544980:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.545043:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140800 00000100:00100000:2.0:1784583810.545053:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140800 00000100:00100000:2.0:1784583810.545146:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:2.0:1784583810.545156:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6156:x1871271580140800:12345-192.168.203.51@tcp:256: 20000000:01000000:2.0:1784583810.545205:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784583810.545295:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784583810.545300:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784583810.545303:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784583810.545306:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784583810.545308:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1784583810.549378:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6156:x1871271580140800:12345-192.168.203.51@tcp:256: Request processed in 4212us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.549391:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:1.0:1784583810.561594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.561740:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580140928 00000100:00100000:0.0:1784583810.561750:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580140928 00000100:00100000:0.0:1784583810.561808:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:0.0:1784583810.561817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+9:6156:x1871271580140928:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1784583810.561832:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583810.561849:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee167 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.561876:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.561886:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583810.561895:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1cc00, rc 0) 00000100:00100000:0.0:1784583810.561959:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6156:x1871271580140928:12345-192.168.203.51@tcp:101: Request processed in 142us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.561981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:1.0:1784583810.573428:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.573846:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141056 00000100:00100000:2.0:1784583810.573856:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141056 00000100:00100000:2.0:1784583810.573910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:2.0:1784583810.573932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6156:x1871271580141056:12345-192.168.203.51@tcp:501: 00000100:00100000:2.0:1784583810.574105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6156:x1871271580141056:12345-192.168.203.51@tcp:501: Request processed in 174us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.574114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:1.0:1784583810.576537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.577044:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141184 00000100:00100000:2.0:1784583810.577114:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141184 00000100:00100000:2.0:1784583810.577170:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:2.0:1784583810.577178:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6156:x1871271580141184:12345-192.168.203.51@tcp:503: 00000100:00100000:2.0:1784583810.577310:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6156:x1871271580141184:12345-192.168.203.51@tcp:503: Request processed in 131us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.577318:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:1.0:1784583810.580168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.580604:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141312 00000100:00100000:0.0:1784583810.580614:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141312 00000100:00100000:0.0:1784583810.580669:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 192 00000100:00100000:0.0:1784583810.580680:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6179:x1871271580141312:12345-192.168.203.51@tcp:502: 00000100:00100000:0.0:1784583810.580823:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6179:x1871271580141312:12345-192.168.203.51@tcp:502: Request processed in 145us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.580831:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 192 00000100:00100000:1.0:1784583810.590911:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583810.592827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141440 00000100:00100000:0.0:1784583810.592839:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141440 00000100:00100000:0.0:1784583810.592908:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:0.0:1784583810.592917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6179:x1871271580141440:12345-192.168.203.51@tcp:502: 00000100:00100000:0.0:1784583810.593265:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6179:x1871271580141440:12345-192.168.203.51@tcp:502: Request processed in 347us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583810.593273:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1784583810.605121:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583810.605177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583810.605276:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141568 00000100:00100000:2.0:1784583810.605286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141568 00000100:00100000:2.0:1784583810.605325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141824 00000100:00100000:2.0:1784583810.605328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141824 00000100:00100000:2.0:1784583810.605360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784583810.605369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1871271580141568:12345-192.168.203.51@tcp:38: 00010000:00080000:2.0:1784583810.605399:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1784583810.605457:0:6515:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e47905 00000004:00100000:2.0:1784583810.605512:0:6515:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784583810.605737:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98b303a93800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583810.605804:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580141568:12345-192.168.203.51@tcp:38: Request processed in 434us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.605812:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784583810.605829:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1784583810.605833:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1871271580141824:12345-192.168.203.51@tcp:38: 00010000:00080000:2.0:1784583810.605854:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1784583810.605884:0:6515:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e4790c 00000004:00100000:2.0:1784583810.605895:0:6515:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784583810.606023:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98b303a96800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583810.606047:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580141824:12345-192.168.203.51@tcp:38: Request processed in 211us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583810.606054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00010000:00010000:1.0:1784583811.245650:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583811.626728:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583811.626770:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583811.626972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142080 00000100:00100000:0.0:1784583811.626980:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142080 00000100:00100000:0.0:1784583811.627050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141696 00000100:00100000:0.0:1784583811.627054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141696 00000100:00100000:0.0:1784583811.627089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1784583811.627098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:6156:x1871271580142080:12345-192.168.203.51@tcp:41: 00000004:00000024:0.0:1784583811.627135:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784583811.627192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:6156:x1871271580142080:12345-192.168.203.51@tcp:41: Request processed in 95us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583811.627200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1784583811.627230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784583811.627236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580141696:12345-192.168.203.51@tcp:41: 00000004:00000024:0.0:1784583811.627246:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784583811.627272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580141696:12345-192.168.203.51@tcp:41: Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583811.627278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00080000:3.0:1784583811.627501:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583811.628093:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583811.629285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580141952 00000100:00100000:0.0:1784583811.629298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580141952 00000100:00100000:0.0:1784583811.629415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:0.0:1784583811.629426:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580141952:12345-192.168.203.51@tcp:41: 00000004:00000024:0.0:1784583811.629458:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583811.629595:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580141952:12345-192.168.203.51@tcp:41: Request processed in 171us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583811.629603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00080000:3.0:1784583811.631929:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583811.635230:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583811.635322:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142208 00000100:00100000:3.0:1784583811.635330:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142208 00000100:00100000:3.0:1784583811.635397:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1784583811.635407:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142208:12345-192.168.203.51@tcp:40: 00000100:00100000:3.0:1784583811.635533:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142208:12345-192.168.203.51@tcp:40: Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583811.635541:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784583811.638425:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583811.638511:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583811.638542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583811.638575:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583811.638613:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142336 00000100:00100000:2.0:1784583811.638622:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142336 00000100:00100000:2.0:1784583811.638652:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142464 00000100:00100000:2.0:1784583811.638655:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142464 00000100:00100000:2.0:1784583811.638671:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784583811.638679:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1871271580142336:12345-192.168.203.51@tcp:8: 00010000:00080000:2.0:1784583811.638712:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1784583811.638763:0:8426:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e47913 00002000:00100000:2.0:1784583811.638777:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfe5cd00-263a-47c1-b0c6-0ab6049cb709/ffff98b43eb03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784583811.638794:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784583811.639031:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784583811.639037:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580142464:12345-192.168.203.51@tcp:8: 00010000:00080000:1.0:1784583811.639054:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1784583811.639090:0:8428:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e4791a 00002000:00100000:1.0:1784583811.639096:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfe5cd00-263a-47c1-b0c6-0ab6049cb709/ffff98b42f7d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784583811.639108:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784583811.639272:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784583811.639303:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b42f7dd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784583811.639361:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580142464:12345-192.168.203.51@tcp:8: Request processed in 323us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583811.639369:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00002000:00080000:2.0:1784583811.639706:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784583811.639723:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b43eb05000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583811.639750:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580142336:12345-192.168.203.51@tcp:8: Request processed in 1070us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583811.639756:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1784583811.640537:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142592 00000100:00100000:0.0:1784583811.640547:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142592 00000100:00100000:0.0:1784583811.640603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784583811.640611:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142592:12345-192.168.203.51@tcp:900: 00000100:00100000:0.0:1784583811.640662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142592:12345-192.168.203.51@tcp:900: Request processed in 52us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583811.640668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1784583811.641338:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142720 00000100:00100000:3.0:1784583811.641346:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142720 00000100:00100000:3.0:1784583811.641389:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:3.0:1784583811.641397:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580142720:12345-192.168.203.51@tcp:400: 00000100:00100000:3.0:1784583811.641491:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580142720:12345-192.168.203.51@tcp:400: Request processed in 69us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583811.641499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:2.0:1784583811.647144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583811.647523:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142848 00000100:00100000:3.0:1784583811.647533:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142848 00000100:00100000:3.0:1784583811.647589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1784583811.647599:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142848:12345-192.168.203.51@tcp:33: 00000004:00080000:3.0:1784583811.682512:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34825us 00000004:00200000:3.0:1784583811.704031:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784583811.704179:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6156:x1871271580142848:12345-192.168.203.51@tcp:33: Request processed in 56563us (57027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583811.704189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784583811.757693:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599062912:0@lo:41: 00000100:00100000:2.0:1784583811.757760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583811.757962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599062912 00000100:00100000:3.0:1784583811.757970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599062912 00000100:00100000:3.0:1784583811.758014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784583811.758022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599062912:12345-0@lo:41: 00000004:00000024:3.0:1784583811.758047:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583811.758103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599062912:12345-0@lo:41: Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583811.758110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784583811.758212:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599062912:0@lo:41: 00000100:00100000:1.0:1784583811.889606:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583811.889699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580142976 00000100:00100000:0.0:1784583811.889708:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580142976 00000100:00100000:0.0:1784583811.889763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1784583811.889773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6197:x1871271580142976:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1784583811.889811:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583811.889869:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d200/0xdab2421a42e47921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee198 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.889928:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.889941:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.890129:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583811.890177:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784583811.890181:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583811.890196:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.890222:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d200/0xdab2421a42e47921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee198 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.890239:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee198 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583811.890248:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1b00) 00010000:00010000:0.0:1784583811.890251:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583811.890255:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1ce00, rc 0) 00000100:00100000:0.0:1784583811.890316:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:6197:x1871271580142976:12345-192.168.203.51@tcp:101: Request processed in 545us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583811.890324:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00010000:00010000:1.0:1784583812.269718:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583813.293640:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583813.293666:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599063424:0@lo:400: 00000100:00100000:2.0:1784583813.293730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583813.293768:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599063296:0@lo:400: 00000100:00100000:2.0:1784583813.293777:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599063040:0@lo:13: 00000100:00100000:1.0:1784583813.293813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583813.293819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583813.293841:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599063808:0@lo:400: 00000100:00100000:2.0:1784583813.293855:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599063936:0@lo:400: 00000100:00100000:1.0:1784583813.293868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583813.293908:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599064320:0@lo:400: 00000100:00100000:0.0:1784583813.293983:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599063552:0@lo:400: 00000100:00100000:3.0:1784583813.294009:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599063168:0@lo:400: 00000100:00100000:2.0:1784583813.298579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583813.298637:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599064448:0@lo:400: 00000100:00100000:2.0:1784583813.298688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583813.298738:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599064960:0@lo:13: 00000100:00100000:2.0:1784583813.298766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583813.298883:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063040 00000100:00100000:2.0:1784583813.298890:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063040 00000100:00100000:2.0:1784583813.298936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064960 00000100:00100000:2.0:1784583813.298939:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064960 00000100:00100000:2.0:1784583813.298956:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784583813.298965:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599063040:12345-0@lo:13: 00002000:00000024:2.0:1784583813.298990:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583813.299028:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599063040:12345-0@lo:13: Request processed in 65us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.299035:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784583813.299050:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784583813.299075:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599064960:12345-0@lo:13: 00002000:00000024:2.0:1784583813.299088:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583813.299113:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599064960:12345-0@lo:13: Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.299119:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784583813.299136:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063296 00000100:00100000:2.0:1784583813.299140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063296 00000100:00100000:2.0:1784583813.299156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063808 00000100:00100000:2.0:1784583813.299158:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063808 00000100:00100000:2.0:1784583813.299171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063936 00000100:00100000:2.0:1784583813.299174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063936 00000100:00100000:2.0:1784583813.299188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064448 00000100:00100000:2.0:1784583813.299190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064448 00000100:00100000:2.0:1784583813.299208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583813.299215:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599063296:12345-0@lo:400: 00000100:00100000:1.0:1784583813.299224:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583813.299255:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599064832:0@lo:13: 00000100:00100000:2.0:1784583813.299256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599063296:12345-0@lo:400: Request processed in 40us (5442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.299267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583813.299278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064320 00000100:00100000:2.0:1784583813.299281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064320 00000100:00100000:1.0:1784583813.299293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583813.299301:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583813.299310:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599063808:12345-0@lo:400: 00000100:00100000:2.0:1784583813.299344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599063808:12345-0@lo:400: Request processed in 36us (5477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.299348:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599063296:0@lo:400: 00000100:00100000:2.0:1784583813.299354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583813.299371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784583813.299372:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599063808:0@lo:400: 00000100:00100000:2.0:1784583813.299380:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599063936:12345-0@lo:400: 00000100:00100000:1.0:1784583813.299412:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784583813.299414:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599063936:12345-0@lo:400: Request processed in 36us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.299426:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599064448:12345-0@lo:400: 00000100:00100000:2.0:1784583813.299433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784583813.299450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583813.299458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599064320:12345-0@lo:400: 00000100:00100000:1.0:1784583813.299488:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599064448:12345-0@lo:400: Request processed in 65us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.299509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784583813.299526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599064320:12345-0@lo:400: Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.299534:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064832 00000100:00100000:2.0:1784583813.299535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784583813.299541:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064832 00000100:00100000:1.0:1784583813.299570:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784583813.299577:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4049bb480 x1871271599064960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583813.299579:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599064832:12345-0@lo:13: 00002000:00000024:1.0:1784583813.299595:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583813.299602:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599064960:0@lo:13: 00010000:00080000:2.0:1784583813.299618:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80ce00 x1871271599063936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583813.299628:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599063936:0@lo:400: 00000100:00100000:1.0:1784583813.299633:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599064832:12345-0@lo:13: Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.299642:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784583813.299645:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80f480 x1871271599064448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583813.299655:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599064448:0@lo:400: 00010000:00080000:2.0:1784583813.299672:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9fb80 x1871271599063040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583813.299680:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1784583813.299693:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599063040:0@lo:13: 00000100:00100000:2.0:1784583813.299712:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583813.299720:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599065088:0@lo:13: 00000100:00100000:2.0:1784583813.299744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784583813.299758:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aaea00 x1871271599064832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583813.299767:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784583813.299784:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599064832:0@lo:13: 00000100:00100000:2.0:1784583813.299793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063424 00000100:00100000:1.0:1784583813.299803:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599064320:0@lo:400: 00000100:00100000:2.0:1784583813.299804:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063424 00000100:00100000:1.0:1784583813.299830:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065088 00000100:00100000:1.0:1784583813.299834:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065088 00000100:00100000:2.0:1784583813.299841:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784583813.299851:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599063424:12345-0@lo:400: 00000100:00100000:1.0:1784583813.299860:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784583813.299870:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599065088:12345-0@lo:13: 00000100:00100000:2.0:1784583813.299890:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599063424:12345-0@lo:400: Request processed in 42us (6160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.299897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784583813.299927:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599063424:0@lo:400: 00000100:00080000:2.0:1784583813.299949:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583813.299953:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583813.299955:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784583813.299957:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583813.300216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.300236:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599064064:0@lo:400: 00000100:00100000:0.0:1784583813.300258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.300273:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599064576:0@lo:400: 00000100:00100000:0.0:1784583813.300289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.300307:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064064 00000100:00100000:0.0:1784583813.300310:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064064 00000100:00100000:0.0:1784583813.300334:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064576 00000100:00100000:0.0:1784583813.300337:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064576 00000100:00100000:0.0:1784583813.300358:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784583813.300365:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599064064:12345-0@lo:400: 00000100:00100000:0.0:1784583813.300393:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599064064:12345-0@lo:400: Request processed in 29us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.300399:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784583813.300410:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784583813.300416:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599064576:12345-0@lo:400: 00000100:00100000:0.0:1784583813.300439:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599064576:12345-0@lo:400: Request processed in 24us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.300445:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784583813.300487:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80ca80 x1871271599064576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583813.300497:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599064576:0@lo:400: 00010000:00080000:0.0:1784583813.300515:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80df80 x1871271599064064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583813.300522:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599064064:0@lo:400: 00000100:00100000:0.0:1784583813.300556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063552 00000100:00100000:0.0:1784583813.300560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063552 00000100:00100000:0.0:1784583813.300583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784583813.300589:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599063552:12345-0@lo:400: 00000100:00100000:0.0:1784583813.300622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599063552:12345-0@lo:400: Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.300629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784583813.300727:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599063552:0@lo:400: 00002000:00000024:1.0:1784583813.300778:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583813.300827:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599065088:12345-0@lo:13: Request processed in 958us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.300833:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583813.300872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784583813.300917:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c7480 x1871271599065088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583813.300919:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599063680:0@lo:400: 00000100:00100000:0.0:1784583813.300940:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599065088:0@lo:13: 00000100:00100000:3.0:1784583813.300955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583813.300976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599064192:0@lo:400: 00000100:00100000:0.0:1784583813.300980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063680 00000100:00100000:0.0:1784583813.300985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063680 00000100:00100000:0.0:1784583813.301017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784583813.301022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.301029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599063680:12345-0@lo:400: 00000100:00100000:3.0:1784583813.301049:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064192 00000100:00100000:3.0:1784583813.301064:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064192 00000100:00100000:0.0:1784583813.301078:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599063680:12345-0@lo:400: Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.301086:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784583813.301097:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784583813.301105:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599064192:12345-0@lo:400: 00000100:00100000:1.0:1784583813.301120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599063168 00000100:00100000:1.0:1784583813.301124:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599063168 00000100:00100000:3.0:1784583813.301139:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599064192:12345-0@lo:400: Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583813.301146:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1784583813.301174:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80fb80 x1871271599064192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583813.301185:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599064192:0@lo:400: 00000100:00100000:0.0:1784583813.301190:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784583813.301194:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599064704:0@lo:400: 00000100:00100000:0.0:1784583813.301201:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599063168:12345-0@lo:400: 00000100:00100000:3.0:1784583813.301223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.301244:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599063168:12345-0@lo:400: Request processed in 44us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.301251:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784583813.301254:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599064704 00000100:00100000:3.0:1784583813.301259:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599064704 00000100:00100000:3.0:1784583813.301290:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784583813.301296:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599064704:12345-0@lo:400: 00000100:00100000:3.0:1784583813.301324:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599064704:12345-0@lo:400: Request processed in 29us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583813.301330:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1784583813.301353:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80ea00 x1871271599064704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583813.301361:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599064704:0@lo:400: 00000100:00100000:3.0:1784583813.301380:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599063168:0@lo:400: 00000100:00100000:3.0:1784583813.301388:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599063680:0@lo:400: 00010000:00010000:2.0:1784583813.302134:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583813.807916:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599065216:0@lo:41: 00000100:00100000:1.0:1784583813.808009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583813.812175:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065216 00000100:00100000:0.0:1784583813.812191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065216 00000100:00100000:0.0:1784583813.812278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784583813.812304:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599065216:12345-0@lo:41: 00000004:00000024:0.0:1784583813.812339:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784583813.812425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599065216:12345-0@lo:41: Request processed in 124us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583813.812622:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599065216:0@lo:41: 00000100:00100000:0.0:1784583813.813039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784583813.964323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583813.965116:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143104 00000100:00100000:2.0:1784583813.965128:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143104 00000100:00080000:3.0:1784583813.965274:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583813.966161:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784583813.966175:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:6250:x1871271580143104:12345-192.168.203.51@tcp:41: 00000004:00000024:2.0:1784583813.966213:0:9809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784583813.966282:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:6250:x1871271580143104:12345-192.168.203.51@tcp:41: Request processed in 110us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.966290:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784583813.971413:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583813.971867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143232 00000100:00100000:0.0:1784583813.971877:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143232 00000100:00100000:0.0:1784583813.971973:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1784583813.971994:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143232:12345-192.168.203.51@tcp:41: 00000100:00080000:3.0:1784583813.972031:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1784583813.972064:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583813.972140:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143232:12345-192.168.203.51@tcp:41: Request processed in 158us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583813.972148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1784583813.976307:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583813.976497:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143360 00000100:00100000:2.0:1784583813.976506:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143360 00000100:00100000:2.0:1784583813.976573:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784583813.976582:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143360:12345-192.168.203.51@tcp:13: 00002000:00000024:2.0:1784583813.976603:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583813.976670:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143360:12345-192.168.203.51@tcp:13: Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.976691:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00080000:3.0:1784583813.976764:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583813.979006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583813.979147:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143488 00000100:00100000:2.0:1784583813.979156:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143488 00000100:00100000:2.0:1784583813.979221:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784583813.979231:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143488:12345-192.168.203.51@tcp:13: 00002000:00000024:2.0:1784583813.979253:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583813.979317:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:6250:x1871271580143488:12345-192.168.203.51@tcp:13: Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583813.979329:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00080000:3.0:1784583813.979500:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784583814.317704:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583815.341749:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784583815.855115:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000001:02000400:0.0:1784583816.279073:0:10177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784583816.365703:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583816.792916:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583816.792958:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583816.793002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583816.793058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583816.793086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583816.793112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143872 00000100:00100000:0.0:1784583816.793121:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143872 00000100:00100000:0.0:1784583816.793175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143744 00000100:00100000:0.0:1784583816.793179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143744 00000100:00100000:0.0:1784583816.793201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784583816.793211:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580143872:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1784583816.793311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580143872:12345-192.168.203.51@tcp:400: Request processed in 101us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583816.793332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784583816.793349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:0.0:1784583816.793357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580143744:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1784583816.793401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580143744:12345-192.168.203.51@tcp:400: Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583816.793407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583816.793723:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144128 00000100:00100000:3.0:1784583816.793728:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144128 00000100:00100000:3.0:1784583816.793764:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144000 00000100:00100000:3.0:1784583816.793768:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144000 00000100:00100000:3.0:1784583816.793790:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1784583816.793797:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144128:12345-192.168.203.51@tcp:400: 00000100:00100000:3.0:1784583816.793833:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144128:12345-192.168.203.51@tcp:400: Request processed in 36us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583816.793840:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1784583816.793851:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:3.0:1784583816.793857:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580144000:12345-192.168.203.51@tcp:400: 00000100:00100000:3.0:1784583816.793882:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580144000:12345-192.168.203.51@tcp:400: Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583816.793888:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00080000:3.0:1784583816.793901:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583816.793905:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583816.793907:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583816.793909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583816.794379:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580143616 00000100:00100000:2.0:1784583816.794385:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580143616 00000100:00100000:2.0:1784583816.794428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:2.0:1784583816.794436:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2401:x1871271580143616:12345-192.168.203.51@tcp:400: 00000100:00100000:2.0:1784583816.794504:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2401:x1871271580143616:12345-192.168.203.51@tcp:400: Request processed in 69us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583816.794511:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:1.0:1784583816.879300:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599065344:0@lo:41: 00000100:00100000:1.0:1784583816.879387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583816.879424:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065344 00000100:00100000:2.0:1784583816.879432:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065344 00000100:00100000:2.0:1784583816.879526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784583816.879537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599065344:12345-0@lo:41: 00000004:00000024:2.0:1784583816.879841:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583816.879900:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599065344:12345-0@lo:41: Request processed in 365us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583816.879907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784583816.880561:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599065344:0@lo:41: 00000001:00100000:0.0:1784583816.882088:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000001:00100000:1.0:1784583816.882862:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00010000:00010000:2.0:1784583817.389804:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784583817.907661:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00010000:00010000:0.0:1784583818.413637:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583818.413657:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599065472:0@lo:13: 00000100:00100000:0.0:1784583818.413728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583818.413799:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065472 00000100:00100000:0.0:1784583818.413807:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065472 00000100:00100000:0.0:1784583818.413869:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784583818.413879:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599065472:12345-0@lo:13: 00002000:00000024:0.0:1784583818.413904:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583818.414037:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599065472:12345-0@lo:13: Request processed in 159us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583818.414044:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1784583818.414270:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aaed80 x1871271599065472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583818.414295:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599065472:0@lo:13: 00000100:00100000:1.0:1784583818.414314:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583818.414321:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599065600:0@lo:13: 00000100:00100000:1.0:1784583818.414566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583818.414600:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065600 00000100:00100000:1.0:1784583818.414605:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065600 00000100:00100000:1.0:1784583818.414640:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784583818.414647:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599065600:12345-0@lo:13: 00002000:00000024:1.0:1784583818.414666:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583818.414718:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599065600:12345-0@lo:13: Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583818.414725:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784583818.414754:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c5c00 x1871271599065600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583818.414781:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599065600:0@lo:13: 00000100:00080000:3.0:1784583818.417654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583818.417663:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784583818.417697:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599065728:0@lo:400: 00000100:00100000:3.0:1784583818.417764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.417799:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599066240:0@lo:400: 00000100:00100000:3.0:1784583818.417838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.417858:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599066752:0@lo:400: 00000100:00100000:3.0:1784583818.417882:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.417907:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784583818.417913:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599065856:0@lo:400: 00000100:00100000:3.0:1784583818.417932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.417947:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599066368:0@lo:400: 00000100:00100000:3.0:1784583818.417964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.417980:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599066880:0@lo:400: 00000100:00100000:3.0:1784583818.417999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418041:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065728 00000100:00100000:3.0:1784583818.418048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065728 00000100:00100000:3.0:1784583818.418090:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784583818.418098:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599065728:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418146:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599065728:12345-0@lo:400: Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418152:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784583818.418183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066240 00000100:00100000:3.0:1784583818.418186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066240 00000100:00100000:3.0:1784583818.418210:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784583818.418216:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599066240:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418248:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599066240:12345-0@lo:400: Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418253:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784583818.418269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066752 00000100:00100000:3.0:1784583818.418272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066752 00000100:00100000:3.0:1784583818.418311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065856 00000100:00100000:3.0:1784583818.418315:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065856 00000100:00100000:3.0:1784583818.418328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066368 00000100:00100000:3.0:1784583818.418330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066368 00000100:00100000:3.0:1784583818.418345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066880 00000100:00100000:3.0:1784583818.418347:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066880 00000100:00100000:3.0:1784583818.418360:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784583818.418366:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599066752:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599066752:12345-0@lo:400: Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784583818.418412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784583818.418418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599065856:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599065856:12345-0@lo:400: Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784583818.418462:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784583818.418498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599066368:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418528:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599066368:12345-0@lo:400: Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784583818.418545:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784583818.418552:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599066880:12345-0@lo:400: 00000100:00100000:3.0:1784583818.418581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599066880:12345-0@lo:400: Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.418588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784583818.418626:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599066112:0@lo:400: 00000100:00100000:3.0:1784583818.418668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418686:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599066624:0@lo:400: 00000100:00100000:3.0:1784583818.418723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418744:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599067136:0@lo:13: 00000100:00100000:3.0:1784583818.418780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418802:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784583818.418809:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599065984:0@lo:400: 00000100:00100000:3.0:1784583818.418831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599066496:0@lo:400: 00000100:00100000:3.0:1784583818.418866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418882:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599067008:0@lo:400: 00000100:00100000:3.0:1784583818.418901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.418927:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066624 00000100:00100000:3.0:1784583818.418931:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066624 00000100:00100000:3.0:1784583818.418960:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067008 00000100:00100000:3.0:1784583818.418963:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067008 00000100:00100000:3.0:1784583818.418984:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583818.418991:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599066624:12345-0@lo:400: 00000100:00100000:3.0:1784583818.419035:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599066624:12345-0@lo:400: Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419041:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784583818.419054:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583818.419060:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599067008:12345-0@lo:400: 00000100:00100000:3.0:1784583818.419085:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599067008:12345-0@lo:400: Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419091:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784583818.419124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066112 00000100:00100000:3.0:1784583818.419128:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066112 00000100:00100000:3.0:1784583818.419146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599066496 00000100:00100000:3.0:1784583818.419149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599066496 00000100:00100000:3.0:1784583818.419168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583818.419174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599066112:12345-0@lo:400: 00000100:00100000:3.0:1784583818.419204:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599066112:12345-0@lo:400: Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419210:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583818.419220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784583818.419226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599066496:12345-0@lo:400: 00000100:00100000:3.0:1784583818.419246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599066496:12345-0@lo:400: Request processed in 21us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784583818.419267:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583818.419270:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583818.419272:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583818.419274:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583818.419281:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599065984 00000100:00100000:3.0:1784583818.419284:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599065984 00000100:00100000:3.0:1784583818.419301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583818.419306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599065984:12345-0@lo:400: 00000100:00100000:3.0:1784583818.419329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599065984:12345-0@lo:400: Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419334:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583818.419353:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067136 00000100:00100000:3.0:1784583818.419356:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067136 00000100:00100000:3.0:1784583818.419373:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583818.419378:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599067136:12345-0@lo:13: 00002000:00000024:3.0:1784583818.419396:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583818.419421:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599067136:12345-0@lo:13: Request processed in 43us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.419426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583818.419458:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599065984:0@lo:400: 00010000:00080000:3.0:1784583818.419486:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8a80 x1871271599066496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583818.419496:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599066496:0@lo:400: 00010000:00080000:3.0:1784583818.419505:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efaa300 x1871271599067008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583818.419513:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599067008:0@lo:400: 00000100:00100000:3.0:1784583818.419521:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599066112:0@lo:400: 00010000:00080000:3.0:1784583818.419528:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efaaa00 x1871271599066624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583818.419535:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599066624:0@lo:400: 00010000:00080000:3.0:1784583818.419542:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8700 x1871271599067136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583818.419553:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599067136:0@lo:13: 00000100:00100000:3.0:1784583818.419588:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599065856:0@lo:400: 00000100:00100000:3.0:1784583818.419596:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599066368:0@lo:400: 00010000:00080000:3.0:1784583818.419605:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8380 x1871271599066880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583818.419624:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599066880:0@lo:400: 00000100:00100000:3.0:1784583818.419633:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599065728:0@lo:400: 00000100:00100000:3.0:1784583818.419641:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599066240:0@lo:400: 00000100:00100000:3.0:1784583818.419650:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599066752:0@lo:400: 00000100:00100000:0.0:1784583818.420354:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583818.420367:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599067264:0@lo:13: 00000100:00100000:0.0:1784583818.420404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583818.420433:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067264 00000100:00100000:0.0:1784583818.420438:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067264 00000100:00100000:0.0:1784583818.420538:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784583818.420545:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599067264:12345-0@lo:13: 00002000:00000024:0.0:1784583818.420563:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583818.420594:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599067264:12345-0@lo:13: Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583818.420600:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1784583818.420627:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aad880 x1871271599067264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583818.420640:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599067264:0@lo:13: 00000100:00100000:0.0:1784583818.926901:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599067392:0@lo:41: 00000100:00100000:0.0:1784583818.926974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583818.927951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067392 00000100:00100000:3.0:1784583818.927963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067392 00000100:00100000:3.0:1784583818.928048:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784583818.928058:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599067392:12345-0@lo:41: 00000004:00000024:3.0:1784583818.928094:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784583818.928588:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599067392:12345-0@lo:41: Request processed in 530us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583818.928596:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784583818.928703:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599067392:0@lo:41: 00010000:00010000:2.0:1784583819.437854:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784583819.654675:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4263dd30 20000000:00000080:0.0:1784583819.654691:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b43cb0fc00 uarg=0000000000000000 20000000:01000000:0.0:1784583819.654730:0:10324:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784583819.654732:0:10324:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784583819.654734:0:10324:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784583819.654738:0:10324:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784583819.654743:0:10324:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784583819.654797:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784583819.654799:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784583819.657123:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1784583819.657861:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1784583819.657898:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1784583819.657917:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1784583819.657931:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784583819.657933:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784583819.658377:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1784583819.659269:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1784583819.659308:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1784583819.659330:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1784583819.659345:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784583819.659347:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784583819.659831:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1784583819.660026:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1784583819.660050:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1784583819.660064:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1784583819.660073:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784583819.660076:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784583819.667041:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1784583819.667492:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1784583819.667555:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1784583819.667571:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1784583819.667584:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784583819.667587:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784583819.668058:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1784583819.668212:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1784583819.668233:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1784583819.668245:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1784583819.668259:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784583819.668278:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668297:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668313:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477ed expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668320:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4782c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668327:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4783a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668334:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47848 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668341:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47864 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668348:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47887 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668355:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e478aa expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668361:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668371:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668379:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668402:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668440:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668455:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 9 pid: 6508 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.668541:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067520:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583819.668736:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668744:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.668753:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aadf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067648:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583819.668784:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668791:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.668800:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aafb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067776:0@lo:104: 00000100:00100000:0.0:1784583819.668845:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583819.668873:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668892:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.668900:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067904:0@lo:104: 00000100:00100000:0.0:1784583819.668942:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583819.668981:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.668989:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 23 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.668997:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068032:0@lo:104: 00000100:00100000:0.0:1784583819.669028:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583819.669045:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669052:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 23 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669059:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068160:0@lo:104: 00000100:00100000:0.0:1784583819.669079:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583819.669095:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669102:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669109:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068288:0@lo:104: 00010000:00010000:0.0:1784583819.669146:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669153:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 23 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669160:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068416:0@lo:104: 00010000:00010000:0.0:1784583819.669179:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669186:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669194:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068544:0@lo:104: 00010000:00010000:0.0:1784583819.669215:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669223:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 23 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669231:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068672:0@lo:104: 00010000:00010000:0.0:1784583819.669253:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.669261:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.669269:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068800:0@lo:104: 00000100:00100000:0.0:1784583819.669285:0:10324:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1784583819.669377:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784583819.669395:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583819.669408:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583819.669415:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583819.669422:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583819.669429:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583819.669440:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067776 00000100:00100000:1.0:1784583819.669446:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067776 00000100:00100000:3.0:1784583819.669630:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599067904 00000100:00100000:3.0:1784583819.669634:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599067904 00000100:00100000:3.0:1784583819.671720:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068032 00000100:00100000:3.0:1784583819.671732:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068032 00000100:00100000:3.0:1784583819.671753:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068160 00000100:00100000:3.0:1784583819.671756:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068160 00000100:00100000:3.0:1784583819.671766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068288 00000100:00100000:3.0:1784583819.671768:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068288 00000100:00100000:3.0:1784583819.671777:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068416 00000100:00100000:3.0:1784583819.671780:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068416 00000100:00100000:3.0:1784583819.671789:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068544 00000100:00100000:3.0:1784583819.671792:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068544 00000100:00100000:3.0:1784583819.671800:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068672 00000100:00100000:3.0:1784583819.671802:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068672 00000100:00100000:3.0:1784583819.671810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068800 00000100:00100000:3.0:1784583819.671824:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068800 00000100:00100000:3.0:1784583819.671845:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784583819.671853:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:10324:x1871271599067776:12345-0@lo:104: 00010000:00010000:3.0:1784583819.671870:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.672006:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583819.672020:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+11:10324:x1871271599067776:12345-0@lo:104: Request processed in 168us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.672027:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784583819.672139:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aafb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067776:0@lo:104: 00000100:00100000:3.0:1784583819.672206:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583819.672214:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:10324:x1871271599067904:12345-0@lo:104: 00010000:00010000:3.0:1784583819.672222:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.672309:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067904:0@lo:104: 00010000:00010000:2.0:1784583819.674193:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784583819.674209:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.674220:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583819.674223:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.674232:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583819.674239:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583819.674244:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583819.674304:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.674310:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784583819.674378:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599068928:0@lo:103: 00000100:00100000:1.0:1784583819.674446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784583819.675272:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.675284:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e478d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.675300:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583819.675319:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.675327:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ba00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583819.675330:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.675337:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583819.675343:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583819.675349:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784583819.675384:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.675391:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784583819.675435:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069056:0@lo:103: 00000100:00100000:0.0:1784583819.675498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583819.675560:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599068928 00000100:00100000:0.0:1784583819.675567:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599068928 00010000:00010000:0.0:1784583819.675610:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 24 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.675637:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069056 00000100:00100000:0.0:1784583819.675640:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069056 00010000:00010000:0.0:1784583819.675652:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 25 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.675673:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784583819.675687:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3639:x1871271599068928:12345-0@lo:103: 00010000:00010000:0.0:1784583819.675701:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583819.675707:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 25 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.675716:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 25 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.675731:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e478db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e478d4 expref: 25 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.675745:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583819.676198:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.676207:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ba00/0xdab2421a42e478aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e478b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583819.676218:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583819.676220:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583819.676223:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583819.676423:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1784583819.676432:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+10:10324:x1871271599067904:12345-0@lo:104: Request processed in 4218us (7488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676450:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583819.676493:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784583819.676502:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:10324:x1871271599068032:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676522:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676574:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583819.676579:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+9:10324:x1871271599068032:12345-0@lo:104: Request processed in 81us (7551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676585:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784583819.676611:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583819.676617:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eb56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+8:10324:x1871271599068160:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676625:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676651:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784583819.676655:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eb56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+8:10324:x1871271599068160:12345-0@lo:104: Request processed in 40us (7576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676661:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583819.676695:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583819.676702:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:10324:x1871271599068288:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676709:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676733:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784583819.676737:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+7:10324:x1871271599068288:12345-0@lo:104: Request processed in 36us (7342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676742:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583819.676754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583819.676759:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:10324:x1871271599068416:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676767:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676790:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784583819.676794:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:10324:x1871271599068416:12345-0@lo:104: Request processed in 36us (7386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676800:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583819.676819:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583819.676825:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:10324:x1871271599068544:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676833:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676860:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784583819.676864:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:10324:x1871271599068544:12345-0@lo:104: Request processed in 40us (7448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676869:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583819.676880:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784583819.676886:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:10324:x1871271599068672:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676893:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676916:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1784583819.676920:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:10324:x1871271599068672:12345-0@lo:104: Request processed in 35us (7498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784583819.676937:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784583819.676943:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10324:x1871271599068800:12345-0@lo:104: 00010000:00010000:3.0:1784583819.676950:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.676976:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1784583819.676981:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10324:x1871271599068800:12345-0@lo:104: Request processed in 39us (7551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.676986:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784583819.677128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1784583819.677142:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784583819.677147:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677153:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677157:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677164:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677171:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677176:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677203:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677208:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677231:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677238:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b44216b800/0xdab2421a42e47887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4788e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677254:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784583819.677257:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677262:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677271:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677278:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677285:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677290:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677304:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677309:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677315:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677320:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e47864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4786b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677331:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784583819.677334:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677340:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ac00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677342:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677348:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677364:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677370:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677384:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677390:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677400:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677407:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e47848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4784f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677415:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784583819.677418:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677422:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677425:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677430:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677435:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677440:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677459:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677501:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677508:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677514:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e4783a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47841 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677524:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784583819.677527:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677532:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677534:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677541:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677547:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677552:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677564:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677569:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677573:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677587:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4782c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47833 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677598:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784583819.677601:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677606:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677609:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677616:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677622:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677627:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677642:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677648:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677652:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677658:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e477ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477f4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677666:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583819.677675:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677681:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583819.677683:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677690:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583819.677696:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583819.677701:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784583819.677715:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677720:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583819.677724:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677730:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e477c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477ca expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.677742:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583819.677744:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583819.677746:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583819.677759:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069184:0@lo:103: 00000100:00100000:3.0:1784583819.677794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069696:0@lo:103: 00000100:00100000:3.0:1784583819.677838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677852:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784583819.677858:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069312:0@lo:103: 00000100:00100000:3.0:1784583819.677876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677886:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069824:0@lo:103: 00000100:00100000:3.0:1784583819.677902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677924:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069568:0@lo:103: 00000100:00100000:3.0:1784583819.677948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677958:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784583819.677963:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069440:0@lo:103: 00000100:00100000:3.0:1784583819.677982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.677991:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069952:0@lo:103: 00000100:00100000:3.0:1784583819.678006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583819.679093:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144256 00000100:00100000:3.0:1784583819.679104:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144256 00010000:00010000:3.0:1784583819.679143:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 10 pid: 6508 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679180:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069184 00000100:00100000:3.0:1784583819.679184:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069184 00010000:00010000:3.0:1784583819.679196:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 25 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679206:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069696 00000100:00100000:3.0:1784583819.679208:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069696 00010000:00010000:3.0:1784583819.679218:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 26 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679226:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069312 00000100:00100000:3.0:1784583819.679241:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069312 00010000:00010000:3.0:1784583819.679254:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 27 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679264:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069824 00000100:00100000:3.0:1784583819.679267:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069824 00010000:00010000:3.0:1784583819.679276:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 28 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679285:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069568 00000100:00100000:3.0:1784583819.679287:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069568 00010000:00010000:3.0:1784583819.679296:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 29 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679305:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069440 00000100:00100000:3.0:1784583819.679307:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069440 00010000:00010000:3.0:1784583819.679316:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 30 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679325:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599069952 00000100:00100000:3.0:1784583819.679327:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599069952 00010000:00010000:3.0:1784583819.679337:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 31 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583819.679351:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583819.679358:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+31:3640:x1871271599069056:12345-0@lo:103: 00010000:00010000:3.0:1784583819.679371:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.679376:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 31 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679386:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 31 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679415:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216a400/0xdab2421a42e478b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e478aa expref: 31 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679432:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583819.679642:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+30:3640:x1871271599069056:12345-0@lo:103: Request processed in 282us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.679650:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583819.679672:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:3.0:1784583819.679678:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580144256:12345-192.168.203.51@tcp:103: 00010000:00010000:3.0:1784583819.679687:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.679691:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 10 pid: 6508 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679701:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 10 pid: 6508 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679712:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583819.679750:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580144256:12345-192.168.203.51@tcp:103: Request processed in 72us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.679756:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:3.0:1784583819.679770:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583819.679776:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+29:3641:x1871271599069184:12345-0@lo:103: 00010000:00010000:3.0:1784583819.679783:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.679787:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 29 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679794:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 29 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.679811:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583819.680052:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583819.680150:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+29:3641:x1871271599069184:12345-0@lo:103: Request processed in 66us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.680158:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583819.680173:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583819.680179:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+28:3641:x1871271599069696:12345-0@lo:103: 00010000:00010000:3.0:1784583819.680187:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.680192:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 28 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.680201:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 28 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.680211:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583819.680237:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+28:3641:x1871271599069696:12345-0@lo:103: Request processed in 59us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.680243:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583819.680256:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583819.680262:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+27:3641:x1871271599069312:12345-0@lo:103: 00010000:00010000:3.0:1784583819.680270:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.680275:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 27 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.680283:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 27 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.680292:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583819.680321:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+27:3641:x1871271599069312:12345-0@lo:103: Request processed in 58us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.680326:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583819.680338:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583819.680343:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+26:3641:x1871271599069824:12345-0@lo:103: 00010000:00010000:3.0:1784583819.680351:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583819.680355:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 26 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.680560:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+26:3639:x1871271599068928:12345-0@lo:103: Request processed in 4873us (6112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583819.680570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784583819.680615:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784583819.680623:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3640:x1871271599069568:12345-0@lo:103: 00010000:00010000:0.0:1784583819.680637:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583819.680642:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 25 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680650:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 25 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680659:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583819.680684:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3640:x1871271599069568:12345-0@lo:103: Request processed in 64us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583819.680690:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784583819.680703:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784583819.680709:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599069440:12345-0@lo:103: 00010000:00010000:0.0:1784583819.680716:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583819.680720:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 24 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680728:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 24 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680736:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583819.680757:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599069440:12345-0@lo:103: Request processed in 48us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583819.680763:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784583819.680775:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784583819.680781:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599069952:12345-0@lo:103: 00010000:00010000:0.0:1784583819.680789:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583819.680793:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680806:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 23 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.680815:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583819.680838:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599069952:12345-0@lo:103: Request processed in 57us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583819.680843:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1784583819.681161:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 22 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583819.681171:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583819.681197:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3641:x1871271599069824:12345-0@lo:103: Request processed in 853us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583819.681204:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784583819.681796:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069312:0@lo:103: 00000100:00100000:3.0:1784583819.681808:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069824:0@lo:103: 00000100:00100000:3.0:1784583819.681815:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069184:0@lo:103: 00000100:00100000:3.0:1784583819.681822:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599069696:0@lo:103: 00000100:00100000:3.0:1784583819.681859:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069440:0@lo:103: 00000100:00100000:3.0:1784583819.681866:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069952:0@lo:103: 00000100:00100000:3.0:1784583819.681873:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069568:0@lo:103: 00000100:00100000:3.0:1784583819.681882:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599069056:0@lo:103: 00000100:00100000:1.0:1784583819.681973:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599068928:0@lo:103: 00010000:00010000:1.0:1784583819.682280:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e478f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee12f expref: 9 pid: 6508 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682295:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067520:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583819.682305:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aadf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599067648:192.168.203.51@tcp:104: 00010000:00010000:1.0:1784583819.682316:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96000/0xdab2421a42e4788e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47887 expref: 21 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682325:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068032:0@lo:104: 00010000:00010000:1.0:1784583819.682339:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4786b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47864 expref: 20 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682347:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068160:0@lo:104: 00010000:00010000:1.0:1784583819.682358:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982a00/0xdab2421a42e4784f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47848 expref: 19 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682440:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068288:0@lo:104: 00010000:00010000:1.0:1784583819.682455:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216a600/0xdab2421a42e47841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4783a expref: 18 pid: 6507 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682701:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068416:0@lo:104: 00010000:00010000:1.0:1784583819.682721:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216aa00/0xdab2421a42e47833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4782c expref: 17 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682745:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068544:0@lo:104: 00010000:00010000:1.0:1784583819.682758:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e477f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e477ed expref: 16 pid: 6506 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682767:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068672:0@lo:104: 00010000:00010000:1.0:1784583819.682775:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e477ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e477c3 expref: 15 pid: 6508 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583819.682782:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1871271599068800:0@lo:104: 00010000:00010000:1.0:1784583819.682818:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583819.689955:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583819.690053:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144384 00000100:00100000:0.0:1784583819.690066:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144384 00010000:00010000:0.0:1784583819.690121:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583819.690160:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1784583819.690170:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+9:2401:x1871271580144384:12345-192.168.203.51@tcp:103: 00010000:00010000:0.0:1784583819.690184:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583819.690190:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690202:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690218:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1da00/0xdab2421a42e478e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee128 expref: 9 pid: 6507 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690233:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690241:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690269:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690276:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690282:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690289:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690295:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583819.690300:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690307:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690327:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583819.690338:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583819.690397:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+8:2401:x1871271580144384:12345-192.168.203.51@tcp:103: Request processed in 228us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583819.690405:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00010000:00010000:1.0:1784583819.690545:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583819.690553:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583819.690559:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e4792f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583820.462391:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784583821.037705:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784583821.037713:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b30245a800 from 48 10000000:01000000:3.0:1784583821.037718:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784583821.037770:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.037781:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.037790:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583821.037810:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070080:0@lo:101: 00000100:00100000:3.0:1784583821.037886:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.037959:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.039404:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070080 00000100:00100000:2.0:1784583821.039421:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070080 00000100:00100000:2.0:1784583821.039527:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784583821.039537:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+15:6510:x1871271599070080:12345-0@lo:101: 00010000:00010000:2.0:1784583821.039553:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583821.039570:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a800/0xdab2421a42e4793d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47936 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.039594:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a800/0xdab2421a42e4793d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47936 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.039606:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a800/0xdab2421a42e4793d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47936 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.039620:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a800, rc 0) 00000100:00100000:2.0:1784583821.039687:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070080:12345-0@lo:101: Request processed in 152us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.039694:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784583821.040034:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070080:0@lo:101: 00010000:00010000:0.0:1784583821.040050:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.040071:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.040140:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070208:0@lo:501: 00000100:00100000:0.0:1784583821.040174:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.040209:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.040270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070208 00000100:00100000:1.0:1784583821.040276:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070208 00000100:00100000:1.0:1784583821.040312:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784583821.040320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070208:12345-0@lo:501: 00000100:00100000:1.0:1784583821.040448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070208:12345-0@lo:501: Request processed in 128us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.040455:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784583821.040743:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070208:0@lo:501: 00000100:00100000:0.0:1784583821.040777:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070336:0@lo:503: 00000100:00100000:0.0:1784583821.040832:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.040856:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.040971:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070336 00000100:00100000:2.0:1784583821.040976:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070336 00000100:00100000:2.0:1784583821.040996:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784583821.041012:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070336:12345-0@lo:503: 00000100:00100000:2.0:1784583821.041097:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070336:12345-0@lo:503: Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.041104:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784583821.041449:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070336:0@lo:503: 00000100:00100000:3.0:1784583821.041980:0:10342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10342:1871271599070464:0@lo:502: 00000100:00100000:3.0:1784583821.042047:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.042076:0:10342:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.042131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070464 00000100:00100000:2.0:1784583821.042136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070464 00000100:00100000:2.0:1784583821.042173:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784583821.042180:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:10342:x1871271599070464:12345-0@lo:502: 00000100:00100000:2.0:1784583821.042282:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:10342:x1871271599070464:12345-0@lo:502: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.042295:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784583821.042432:0:10342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10342:1871271599070464:0@lo:502: 00000100:00100000:3.0:1784583821.042493:0:10342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10342:1871271599070592:0@lo:502: 00000100:00100000:3.0:1784583821.042527:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.042556:0:10342:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.042802:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070592 00000100:00100000:1.0:1784583821.042807:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070592 00000100:00100000:1.0:1784583821.042850:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784583821.042858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:10342:x1871271599070592:12345-0@lo:502: 00000100:00100000:1.0:1784583821.042934:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:10342:x1871271599070592:12345-0@lo:502: Request processed in 77us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.042941:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784583821.043115:0:10342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10342:1871271599070592:0@lo:502: 00000040:00080000:3.0:1784583821.043136:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784583821.043292:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784583821.043312:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784583821.043321:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.043342:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583821.043352:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784583821.043354:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1784583821.043357:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784583821.043382:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.043390:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.043405:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.043418:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070720:0@lo:101: 00000100:00100000:0.0:1784583821.043448:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.043501:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.043666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070720 00000100:00100000:1.0:1784583821.043671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070720 00000100:00100000:1.0:1784583821.043706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784583821.043713:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+16:6510:x1871271599070720:12345-0@lo:101: 00010000:00010000:1.0:1784583821.043721:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583821.043732:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982a00/0xdab2421a42e4794b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47944 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.043751:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982a00/0xdab2421a42e4794b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47944 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.043760:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982a00/0xdab2421a42e4794b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47944 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.043768:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982a00, rc 0) 00000100:00100000:1.0:1784583821.043809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599070720:12345-0@lo:101: Request processed in 97us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.043911:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784583821.043987:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070720:0@lo:101: 00010000:00010000:2.0:1784583821.044000:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.044019:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583821.044069:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070848:0@lo:501: 00000100:00100000:2.0:1784583821.044096:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583821.044117:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32900 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.044394:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070848 00000100:00100000:3.0:1784583821.044400:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070848 00000100:00100000:3.0:1784583821.044434:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784583821.044451:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599070848:12345-0@lo:501: 00000100:00100000:3.0:1784583821.044587:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599070848:12345-0@lo:501: Request processed in 136us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.044594:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784583821.044819:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070848:0@lo:501: 00000100:00100000:1.0:1784583821.044971:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070976:0@lo:503: 00000100:00100000:1.0:1784583821.045025:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.045071:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f240 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.045114:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599070976 00000100:00100000:3.0:1784583821.045118:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599070976 00000100:00100000:3.0:1784583821.045155:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784583821.045163:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599070976:12345-0@lo:503: 00000100:00100000:3.0:1784583821.045244:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599070976:12345-0@lo:503: Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.045251:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784583821.045459:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599070976:0@lo:503: 00000100:00100000:2.0:1784583821.046017:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10343:1871271599071104:0@lo:502: 00000100:00100000:2.0:1784583821.046065:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583821.046094:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.046138:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071104 00000100:00100000:3.0:1784583821.046143:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071104 00000100:00100000:3.0:1784583821.046179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784583821.046185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:10343:x1871271599071104:12345-0@lo:502: 00000100:00100000:3.0:1784583821.046273:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:10343:x1871271599071104:12345-0@lo:502: Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.046280:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784583821.046515:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10343:1871271599071104:0@lo:502: 00000020:01000000:2.0:1784583821.046537:0:10343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583821.046545:0:10343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583821.046547:0:10343:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784583821.046552:0:10343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784583821.046571:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10343:1871271599071232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.046602:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583821.046619:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.046673:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071232 00000100:00100000:0.0:1784583821.046677:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071232 00000100:00100000:0.0:1784583821.046699:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784583821.046705:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:10343:x1871271599071232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583821.046778:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:10343:x1871271599071232:12345-0@lo:502:llog_process_th.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.046785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784583821.047013:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10343:1871271599071232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784583821.047042:0:10343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583821.047047:0:10343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583821.047049:0:10343:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784583821.047057:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1784583821.048593:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1784583821.048626:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784583821.048636:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.048648:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583821.048658:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784583821.048660:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b43e967000 from 48 10000000:01000000:1.0:1784583821.048663:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784583821.048699:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.048706:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.048715:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583821.048734:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.048783:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.048813:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.049587:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071360 00000100:00100000:0.0:1784583821.049596:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071360 00000100:00100000:0.0:1784583821.049637:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784583821.049645:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+17:6510:x1871271599071360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.049658:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583821.049670:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c400/0xdab2421a42e47959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47952 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.049693:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c400/0xdab2421a42e47959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47952 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.049703:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c400/0xdab2421a42e47959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47952 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.049728:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c400, rc 0) 00000100:00100000:0.0:1784583821.049783:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599071360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.049789:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1784583821.049978:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583821.049993:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.050011:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583821.050088:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.050126:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.050157:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.050196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071488 00000100:00100000:2.0:1784583821.050201:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071488 00000100:00100000:2.0:1784583821.050232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784583821.050239:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599071488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.050362:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599071488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.050369:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784583821.051026:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.051144:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.051188:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.051248:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.051280:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071616 00000100:00100000:2.0:1784583821.051286:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071616 00000100:00100000:2.0:1784583821.051360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784583821.051369:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599071616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.051623:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599071616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.051631:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784583821.052053:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599071616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.052885:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10344:1871271599071744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.052941:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.053022:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58780 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.053056:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071744 00000100:00100000:1.0:1784583821.053062:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071744 00000100:00100000:1.0:1784583821.053206:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784583821.053215:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:10344:x1871271599071744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.053564:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:10344:x1871271599071744:12345-0@lo:502:llog_process_th.0 Request processed in 349us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.053572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784583821.053642:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10344:1871271599071744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.053683:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10344:1871271599071872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.053716:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.053777:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58780 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.053808:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599071872 00000100:00100000:2.0:1784583821.053813:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599071872 00000100:00100000:2.0:1784583821.053942:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784583821.053951:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:10344:x1871271599071872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.054038:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:10344:x1871271599071872:12345-0@lo:502:llog_process_th.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.054045:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784583821.054100:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10344:1871271599071872:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784583821.054118:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784583821.054274:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784583821.054293:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784583821.054302:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.054313:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583821.054322:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784583821.054334:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1784583821.054337:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784583821.054361:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.054368:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.054376:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583821.054388:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.054416:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.054696:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f480 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.054776:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072000 00000100:00100000:0.0:1784583821.054781:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072000 00000100:00100000:0.0:1784583821.054805:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784583821.054811:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+18:6510:x1871271599072000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.054827:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583821.054839:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c800/0xdab2421a42e47967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47960 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.054859:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c800/0xdab2421a42e47967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47960 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.054869:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c800/0xdab2421a42e47967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47960 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.054876:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c800, rc 0) 00000100:00100000:0.0:1784583821.054914:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.054920:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784583821.055076:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583821.055089:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.055105:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583821.055154:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.055177:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.055197:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f480 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.055244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072128 00000100:00100000:0.0:1784583821.055248:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072128 00000100:00100000:0.0:1784583821.055275:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784583821.055280:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.055506:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.055520:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784583821.055660:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.055687:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.055724:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.055748:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.055789:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072256 00000100:00100000:2.0:1784583821.055794:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072256 00000100:00100000:2.0:1784583821.055832:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784583821.055838:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.055922:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.055934:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784583821.056073:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.056667:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10345:1871271599072384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.056708:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.056768:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f180 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.056806:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072384 00000100:00100000:2.0:1784583821.056811:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072384 00000100:00100000:2.0:1784583821.056954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784583821.056963:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:10345:x1871271599072384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.057064:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:10345:x1871271599072384:12345-0@lo:502:llog_process_th.0 Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.057071:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784583821.057136:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10345:1871271599072384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583821.057157:0:10345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583821.057166:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583821.057168:0:10345:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784583821.057173:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784583821.057192:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10345:1871271599072512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.057222:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.057287:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.057354:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072512 00000100:00100000:0.0:1784583821.057359:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072512 00000100:00100000:0.0:1784583821.057380:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784583821.057386:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:10345:x1871271599072512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583821.057461:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:10345:x1871271599072512:12345-0@lo:502:llog_process_th.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.057485:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784583821.057605:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10345:1871271599072512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583821.057628:0:10345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583821.057631:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583821.057633:0:10345:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784583821.057636:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1784583821.057831:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1784583821.057849:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784583821.057857:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.057867:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583821.057876:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784583821.057878:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b42ba2f000 from 48 10000000:01000000:0.0:1784583821.057881:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784583821.057901:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.057909:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.057918:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.057930:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.057961:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.057988:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.058033:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072640 00000100:00100000:1.0:1784583821.058037:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072640 00000100:00100000:1.0:1784583821.058058:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784583821.058063:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:6510:x1871271599072640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583821.058072:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583821.058082:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982200/0xdab2421a42e47975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4796e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.058101:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982200/0xdab2421a42e47975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4796e expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.058111:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982200/0xdab2421a42e47975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4796e expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.058118:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982200, rc 0) 00000100:00100000:1.0:1784583821.058149:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599072640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.058155:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784583821.058209:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.058219:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.058228:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.058266:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.058286:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.058336:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.058486:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072768 00000100:00100000:2.0:1784583821.058490:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072768 00000100:00100000:3.0:1784583821.058547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784583821.058555:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599072768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.058645:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599072768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.058651:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784583821.058711:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.058733:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.058765:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.058934:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.058962:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599072896 00000100:00100000:1.0:1784583821.058966:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599072896 00000100:00100000:1.0:1784583821.058983:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784583821.058989:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599072896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.059069:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599072896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.059083:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784583821.059159:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599072896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.059417:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10346:1871271599073024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583821.059456:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.059488:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.059592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073024 00000100:00100000:1.0:1784583821.059596:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073024 00000100:00100000:1.0:1784583821.059613:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784583821.059617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:10346:x1871271599073024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.059680:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:10346:x1871271599073024:12345-0@lo:502:llog_process_th.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.059687:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784583821.059717:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10346:1871271599073024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.059745:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10346:1871271599073152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.059771:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.059785:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073152 00000100:00100000:1.0:1784583821.059788:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073152 00000100:00100000:1.0:1784583821.059801:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784583821.059805:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:10346:x1871271599073152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.060053:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:10346:x1871271599073152:12345-0@lo:502:llog_process_th.0 Request processed in 245us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.060060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784583821.060089:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.060099:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10346:1871271599073152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784583821.060114:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784583821.061728:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784583821.061761:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784583821.061772:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.061803:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583821.061813:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784583821.061816:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1784583821.061903:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784583821.061937:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.061947:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.061957:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.061980:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.062054:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.062235:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.063670:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073280 00000100:00100000:3.0:1784583821.063682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073280 00000100:00100000:3.0:1784583821.063752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784583821.063761:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599073280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583821.063776:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583821.063790:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97800/0xdab2421a42e47983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4797c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.063814:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97800/0xdab2421a42e47983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4797c expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.063967:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97800/0xdab2421a42e47983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4797c expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.063977:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97800, rc 0) 00000100:00100000:3.0:1784583821.064057:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.064064:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784583821.064345:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.064364:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.064374:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.064450:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.064510:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.064550:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.064667:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073408 00000100:00100000:2.0:1784583821.064672:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073408 00000100:00100000:2.0:1784583821.064709:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784583821.064716:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.064841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.064848:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784583821.065047:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.065079:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.065130:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.065155:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.065301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073536 00000100:00100000:2.0:1784583821.065305:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073536 00000100:00100000:2.0:1784583821.065342:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784583821.065349:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.065424:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.065431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784583821.065625:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.066091:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10347:1871271599073664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583821.066127:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.066232:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52000 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.066411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073664 00000100:00100000:1.0:1784583821.066416:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073664 00000100:00100000:1.0:1784583821.066524:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784583821.066532:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10347:x1871271599073664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.066637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10347:x1871271599073664:12345-0@lo:502:llog_process_th.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.066644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784583821.066725:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10347:1871271599073664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784583821.066750:0:10347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583821.066758:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583821.066760:0:10347:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784583821.066766:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784583821.066786:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10347:1871271599073792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.066821:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.068171:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.068315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073792 00000100:00100000:2.0:1784583821.068323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073792 00000100:00100000:2.0:1784583821.068373:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784583821.068381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10347:x1871271599073792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.068562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10347:x1871271599073792:12345-0@lo:502:llog_process_th.0 Request processed in 181us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.068569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784583821.069029:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10347:1871271599073792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784583821.069063:0:10347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583821.069070:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583821.069072:0:10347:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784583821.069222:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1784583821.069440:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1784583821.069461:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784583821.069489:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.069499:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583821.069508:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784583821.069510:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b418942800 from 48 10000000:01000000:2.0:1784583821.069665:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784583821.069692:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.069700:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.069711:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583821.069736:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.069780:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.069808:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599073920 00000100:00100000:2.0:1784583821.069809:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4227d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1784583821.069813:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599073920 00000100:00100000:0.0:1784583821.069945:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784583821.069954:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599073920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.069966:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583821.069980:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c000/0xdab2421a42e47991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4798a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.070012:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c000/0xdab2421a42e47991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4798a expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.070023:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c000/0xdab2421a42e47991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4798a expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.070048:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c000, rc 0) 00000100:00100000:0.0:1784583821.070086:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599073920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.070093:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784583821.070970:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599073920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583821.070999:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.071019:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583821.071131:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.071168:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583821.071235:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4227d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.071267:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074048 00000100:00100000:1.0:1784583821.071273:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074048 00000100:00100000:1.0:1784583821.071388:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784583821.071397:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599074048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.071672:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599074048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.071679:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784583821.071726:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.071749:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.071784:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583821.071798:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4227d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.072576:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074176 00000100:00100000:3.0:1784583821.072583:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074176 00000100:00100000:3.0:1784583821.072653:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784583821.072662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599074176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.072769:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599074176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.072776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784583821.072877:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.073339:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10348:1871271599074304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.073380:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.075716:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074304 00000100:00100000:3.0:1784583821.075729:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074304 00000100:00100000:1.0:1784583821.078010:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f540 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.079941:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784583821.079961:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10348:x1871271599074304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.080163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10348:x1871271599074304:12345-0@lo:502:llog_process_th.0 Request processed in 211us (6782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.080181:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784583821.080655:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10348:1871271599074304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.080722:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10348:1871271599074432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.080769:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.080805:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.080858:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074432 00000100:00100000:2.0:1784583821.080865:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074432 00000100:00100000:2.0:1784583821.080904:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784583821.080911:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10348:x1871271599074432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.081012:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10348:x1871271599074432:12345-0@lo:502:llog_process_th.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.081020:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784583821.082618:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10348:1871271599074432:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784583821.082669:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784583821.082903:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784583821.082923:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784583821.082932:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.082943:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583821.082953:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784583821.082955:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1784583821.082958:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784583821.082992:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.082999:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.083018:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.083046:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.083096:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.083136:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52780 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.083724:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074560 00000100:00100000:1.0:1784583821.083732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074560 00000100:00100000:1.0:1784583821.083777:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784583821.083785:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599074560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583821.083813:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583821.083839:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983c00/0xdab2421a42e4799f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47998 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.083864:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983c00/0xdab2421a42e4799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47998 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.083875:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983c00/0xdab2421a42e4799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47998 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.083883:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983c00, rc 0) 00000100:00100000:1.0:1784583821.083935:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599074560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.083942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784583821.084084:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583821.084097:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583821.084106:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583821.084170:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.084195:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.084227:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52780 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.084321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074688 00000100:00100000:1.0:1784583821.084333:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074688 00000100:00100000:1.0:1784583821.084361:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784583821.084368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599074688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.084486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599074688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.084493:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784583821.084606:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.084631:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583821.084668:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583821.084694:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52780 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.085034:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074816 00000100:00100000:2.0:1784583821.085040:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074816 00000100:00100000:2.0:1784583821.085069:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784583821.085077:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599074816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583821.085173:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599074816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.085190:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784583821.085230:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599074816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.085670:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10349:1871271599074944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.085708:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.085739:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a240 going to sleep for 11 seconds 00000100:00100000:2.0:1784583821.085789:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599074944 00000100:00100000:2.0:1784583821.085793:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599074944 00000100:00100000:2.0:1784583821.085918:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784583821.085927:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10349:x1871271599074944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583821.086023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10349:x1871271599074944:12345-0@lo:502:llog_process_th.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.086041:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784583821.086572:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10349:1871271599074944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583821.086605:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583821.086614:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583821.086617:0:10349:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784583821.086622:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784583821.086645:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10349:1871271599075072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583821.086679:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.086697:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a240 going to sleep for 11 seconds 00000100:00100000:3.0:1784583821.087050:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075072 00000100:00100000:3.0:1784583821.087056:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075072 00000100:00100000:3.0:1784583821.087085:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784583821.087093:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10349:x1871271599075072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583821.087202:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10349:x1871271599075072:12345-0@lo:502:llog_process_th.0 Request processed in 109us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583821.087209:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784583821.088917:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10349:1871271599075072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583821.088958:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583821.088967:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583821.088969:0:10349:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784583821.088974:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1784583821.089185:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1784583821.089219:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784583821.089230:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.089254:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583821.089264:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784583821.089266:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b4331acd40 from 1 10000000:01000000:3.0:1784583821.089269:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784583821.089300:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.089309:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.089318:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583821.089339:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599075200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.089393:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.089437:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.089945:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075200 00000100:00100000:1.0:1784583821.089953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075200 00000100:00100000:1.0:1784583821.089991:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784583821.089999:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599075200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583821.090022:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583821.090035:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983200/0xdab2421a42e479ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e479a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.090056:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983200/0xdab2421a42e479ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e479a6 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.090066:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983200/0xdab2421a42e479ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479a6 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583821.090075:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983200, rc 0) 00000100:00100000:1.0:1784583821.090117:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599075200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.090130:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784583821.090352:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599075200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583821.090723:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.090734:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583821.090866:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599075328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583821.090899:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583821.090938:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784583821.090998:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075328 00000100:00100000:1.0:1784583821.091013:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075328 00000100:00100000:1.0:1784583821.091038:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784583821.091044:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599075328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583821.091123:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599075328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (223us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784583821.091130:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784583821.091450:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599075328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784583821.091508:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784583821.091514:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583821.091594:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583821.486424:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583821.910521:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583821.910557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583821.910726:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144640 00000100:00100000:0.0:1784583821.910736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144640 00000100:00100000:0.0:1784583821.910812:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1784583821.910821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580144640:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1784583821.910910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580144640:12345-192.168.203.51@tcp:400: Request processed in 89us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.910918:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00080000:2.0:1784583821.910980:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583821.911272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583821.911305:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583821.911337:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583821.911377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144768 00000100:00100000:2.0:1784583821.911382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144768 00000100:00100000:2.0:1784583821.911419:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1784583821.911428:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144768:12345-192.168.203.51@tcp:400: 00000100:00100000:2.0:1784583821.911485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144768:12345-192.168.203.51@tcp:400: Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583821.911493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00080000:2.0:1784583821.911560:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583821.911717:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144512 00000100:00100000:0.0:1784583821.911721:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144512 00000100:00100000:0.0:1784583821.911755:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 240 00000100:00100000:0.0:1784583821.911763:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+8:2401:x1871271580144512:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1784583821.911797:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+8:2401:x1871271580144512:12345-192.168.203.51@tcp:400: Request processed in 35us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583821.911803:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 240 00000100:00100000:1.0:1784583821.929297:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580144896 00000100:00100000:1.0:1784583821.929314:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580144896 00000100:00100000:1.0:1784583821.929402:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145024 00000100:00100000:1.0:1784583821.929406:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145024 00000100:00100000:1.0:1784583821.929433:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784583821.929442:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144896:12345-192.168.203.51@tcp:400: 00000100:00100000:1.0:1784583821.929536:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580144896:12345-192.168.203.51@tcp:400: Request processed in 95us (18977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.929544:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784583821.929561:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784583821.929567:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580145024:12345-192.168.203.51@tcp:400: 00000100:00100000:1.0:1784583821.929590:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580145024:12345-192.168.203.51@tcp:400: Request processed in 23us (18253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.929596:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00080000:3.0:1784583821.929868:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583821.929873:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583821.997872:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583821.997895:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599075456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583821.997973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583821.998409:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075456 00000100:00100000:1.0:1784583821.998541:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075456 00000100:00100000:1.0:1784583821.998598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784583821.998608:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599075456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583821.998654:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583821.998721:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599075456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583821.998728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784583821.998820:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599075456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583822.509835:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583823.533796:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583823.533868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583823.533893:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075584 00000100:00100000:0.0:1784583823.533900:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075584 00000100:00100000:3.0:1784583823.533952:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583823.533962:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784583823.533998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583823.534004:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599075584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784583823.534033:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583823.534037:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599075840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583823.534078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.534097:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583823.534103:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599075968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583823.534133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784583823.534170:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583823.537854:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1784583823.538576:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599076096:0@lo:400:kworker.0 00000100:00100000:2.0:1784583823.538600:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1784583823.538657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583823.538752:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076096 00000100:00100000:2.0:1784583823.538759:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076096 00000100:00100000:2.0:1784583823.538806:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784583823.538814:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583823.538860:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599076096:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583823.539289:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599075584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5303us (5418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583823.539299:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1784583823.539396:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583823.539403:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075712 00000100:00100000:0.0:1784583823.539407:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075712 00000100:00100000:0.0:1784583823.539434:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075840 00000100:00100000:0.0:1784583823.539436:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075840 00000100:00100000:0.0:1784583823.539446:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599075968 00000100:00100000:0.0:1784583823.539448:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599075968 00000100:00100000:0.0:1784583823.539460:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784583823.539623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784583823.539739:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784583823.539746:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599075840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583823.539769:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583823.539819:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599075840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (5741us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583823.539825:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784583823.539836:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784583823.539842:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599075968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583823.539850:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1784583823.543246:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583823.543256:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784583823.543302:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a37800 x1871271599075840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583823.543327:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599075840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583823.543385:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599076224:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.543451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.543522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076224 00000100:00100000:3.0:1784583823.543527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076224 00000100:00100000:3.0:1784583823.543570:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784583823.543579:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599076224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.543624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599076224:12345-0@lo:400:kworker.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.543631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784583823.543659:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599076224:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.543688:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599076352:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.543711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.543733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076352 00000100:00100000:3.0:1784583823.543737:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076352 00000100:00100000:3.0:1784583823.543935:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784583823.543942:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599076352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.543981:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599076352:12345-0@lo:400:kworker.0 Request processed in 40us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.544013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784583823.544042:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599076352:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599076480:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.544118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076480 00000100:00100000:3.0:1784583823.544121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076480 00000100:00100000:3.0:1784583823.544141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784583823.544146:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599076480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544178:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599076480:12345-0@lo:400:kworker.0 Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.544183:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784583823.544207:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599076480:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544238:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583823.544243:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599076608:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.544280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076608 00000100:00100000:3.0:1784583823.544283:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076608 00000100:00100000:3.0:1784583823.544298:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784583823.544303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599076608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544331:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599076608:12345-0@lo:400:kworker.0 Request processed in 28us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.544337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784583823.544358:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599076608:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599076736:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.544429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076736 00000100:00100000:3.0:1784583823.544432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076736 00000100:00100000:3.0:1784583823.544455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784583823.544461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599076736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599076736:12345-0@lo:400:kworker.0 Request processed in 166us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.544633:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784583823.544657:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599076736:0@lo:400:kworker.0 00000100:00080000:3.0:1784583823.544670:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583823.544692:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599076864:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.544736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076864 00000100:00100000:3.0:1784583823.544739:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076864 00000100:00100000:3.0:1784583823.544835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784583823.544841:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599076864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544874:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599076864:12345-0@lo:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.544879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1784583823.544896:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784583823.544911:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aace00 x1871271599076864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583823.544922:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599076864:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544948:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599076992:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.544970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.545014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599076992 00000100:00100000:3.0:1784583823.545018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599076992 00000100:00100000:3.0:1784583823.545041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784583823.545047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.545079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599076992:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.545084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784583823.545108:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599076992:0@lo:400:kworker.0 00000100:00080000:3.0:1784583823.545119:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583823.545141:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583823.545148:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599077120:0@lo:400:kworker.0 00000100:00100000:3.0:1784583823.545171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583823.545196:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077120 00000100:00100000:3.0:1784583823.545199:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077120 00000100:00100000:2.0:1784583823.545209:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599075968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5359us (11067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583823.545220:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583823.545227:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784583823.545234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599077120:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784583823.545280:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a35880 x1871271599075968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583823.545286:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599077120:12345-0@lo:400:kworker.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583823.545299:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784583823.545309:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599075968:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784583823.545332:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aace00 x1871271599077120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583823.545342:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599077120:0@lo:400:kworker.0 00000100:00080000:3.0:1784583823.545359:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583823.547350:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583823.547395:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583823.547503:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8032us (13512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583823.547521:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1784583823.548666:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c6680 x1871271599075712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583823.548691:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599075712:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1784583823.548871:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30404e300 x1871271599075584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583823.548885:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583823.548907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599076096:0@lo:400:kworker.0 00000100:00100000:0.0:1784583824.045866:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599077248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583824.045939:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583824.046259:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077248 00000100:00100000:3.0:1784583824.046266:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077248 00000100:00100000:3.0:1784583824.046316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784583824.046325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599077248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583824.046354:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784583824.046405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599077248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583824.046412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784583824.046541:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599077248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583824.558676:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583824.984869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583824.985149:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145152 00000100:00100000:2.0:1784583824.985162:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145152 00000100:00100000:2.0:1784583824.985231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 242 00000100:00100000:2.0:1784583824.985243:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+8:6171:x1871271580145152:12345-192.168.203.51@tcp:101: 00010000:00010000:2.0:1784583824.985259:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583824.985279:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e479b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee19f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583824.985309:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e479b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee19f expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583824.985337:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e479b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee19f expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583824.985347:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a000, rc 0) 00000100:00100000:2.0:1784583824.985660:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145152:12345-192.168.203.51@tcp:101: Request processed in 417us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583824.985677:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 242 00000100:00100000:1.0:1784583824.991256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583824.991499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145280 00000100:00100000:2.0:1784583824.991509:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145280 00000100:00100000:2.0:1784583824.991567:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:2.0:1784583824.991576:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145280:12345-192.168.203.51@tcp:501: 00000100:00100000:2.0:1784583824.991736:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145280:12345-192.168.203.51@tcp:501: Request processed in 160us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583824.991744:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:3.0:1784583824.995871:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583824.995940:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145408 00000100:00100000:0.0:1784583824.995951:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145408 00000100:00100000:0.0:1784583824.996014:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:0.0:1784583824.996024:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145408:12345-192.168.203.51@tcp:503: 00000100:00100000:0.0:1784583824.996175:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145408:12345-192.168.203.51@tcp:503: Request processed in 151us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583824.996188:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:1.0:1784583824.999058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583824.999339:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145536 00000100:00100000:0.0:1784583824.999349:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145536 00000100:00100000:0.0:1784583824.999502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:0.0:1784583824.999512:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+9:6669:x1871271580145536:12345-192.168.203.51@tcp:502: 00000100:00100000:0.0:1784583824.999648:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+9:6669:x1871271580145536:12345-192.168.203.51@tcp:502: Request processed in 137us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583824.999656:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:1.0:1784583825.003091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583825.003416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145664 00000100:00100000:2.0:1784583825.003425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145664 00000100:00100000:2.0:1784583825.003498:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:2.0:1784583825.003507:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6669:x1871271580145664:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784583825.003641:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+9:6669:x1871271580145664:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 134us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583825.003649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:3.0:1784583825.010892:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583825.011439:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145792 00000100:00100000:2.0:1784583825.011450:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145792 00000100:00100000:2.0:1784583825.011538:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 247 00000100:00100000:2.0:1784583825.011549:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580145792:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583825.011579:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583825.011597:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e479bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee1a6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583825.011626:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e479bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1a6 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583825.011636:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e479bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1a6 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583825.011645:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b600, rc 0) 00000100:00100000:2.0:1784583825.011813:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580145792:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 265us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583825.011820:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 247 00000100:00100000:1.0:1784583825.021213:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583825.021352:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580145920 00000100:00100000:0.0:1784583825.021533:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580145920 00000100:00100000:0.0:1784583825.021642:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 248 00000100:00100000:0.0:1784583825.021653:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580145920:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583825.021766:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580145920:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 114us (561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784583825.021775:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 248 00010000:00010000:0.0:1784583825.581958:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784583826.072033:0:10387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecbae7a20 20000000:00000080:3.0:1784583826.072051:0:10387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b43ea5cc00 uarg=0000000000000000 20000000:01000000:3.0:1784583826.072096:0:10387:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784583826.072101:0:10387:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784583826.072106:0:10387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784583826.072712:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784583826.072867:0:10387:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1784583826.076717:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1784583826.076754:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1784583826.076769:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1784583826.076784:0:10387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784583826.076803:0:10387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076821:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076828:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47665 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076850:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076857:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e477df expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076865:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076872:0:10387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076910:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.076923:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 9 pid: 6507 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.076938:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077376:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583826.077094:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077103:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 23 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.077113:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077504:0@lo:104: 00000100:00100000:3.0:1784583826.077153:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784583826.077190:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077205:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.077214:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077632:0@lo:104: 00000100:00100000:3.0:1784583826.077240:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583826.077277:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784583826.077288:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077504 00000100:00100000:3.0:1784583826.077294:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077504 00000100:00100000:3.0:1784583826.077339:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077632 00000100:00100000:3.0:1784583826.077342:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077632 00000100:00100000:3.0:1784583826.077357:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784583826.077364:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:10387:x1871271599077504:12345-0@lo:104: 00010000:00010000:3.0:1784583826.077375:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077419:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583826.077425:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:10387:x1871271599077504:12345-0@lo:104: Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.077432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784583826.077449:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784583826.077455:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eb89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599077632:12345-0@lo:104: 00010000:00010000:3.0:1784583826.077463:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077518:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784583826.077523:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eb89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599077632:12345-0@lo:104: Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.077541:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1784583826.077575:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784583826.077581:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077588:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583826.077592:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077601:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583826.077607:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583826.077612:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583826.077639:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077646:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583826.077666:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077672:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e477df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e477e6 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077686:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583826.077689:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077705:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583826.077708:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077715:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583826.077720:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583826.077725:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583826.077740:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077745:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583826.077752:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077758:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e476b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e476c0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.077769:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.077771:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.077773:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583826.077791:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599077888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583826.077817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583826.077837:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583826.077842:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599077760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583826.077870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583826.077893:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077888 00000100:00100000:3.0:1784583826.077896:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077888 00010000:00010000:3.0:1784583826.077914:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 24 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.077931:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599077760 00000100:00100000:3.0:1784583826.077934:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599077760 00010000:00010000:3.0:1784583826.077942:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 25 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.077959:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784583826.077964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3640:x1871271599077888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583826.077987:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583826.077993:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 25 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078001:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 25 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078016:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583826.078041:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3640:x1871271599077888:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.078048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784583826.078060:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583826.078066:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599077760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583826.078073:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583826.078077:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 24 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078095:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 24 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078104:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583826.078125:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599077760:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.078131:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583826.078162:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599077760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583826.078169:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599077888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583826.078203:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078213:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.078221:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599078016:0@lo:104: 00000100:00100000:3.0:1784583826.078241:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583826.078261:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078016 00000100:00100000:3.0:1784583826.078264:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078016 00000100:00100000:3.0:1784583826.078280:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784583826.078285:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599078016:12345-0@lo:104: 00010000:00010000:3.0:1784583826.078293:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078322:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583826.078327:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599078016:12345-0@lo:104: Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.078341:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1784583826.078354:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583826.078360:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078367:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583826.078370:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078377:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583826.078383:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583826.078388:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583826.078404:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078411:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583826.078427:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078433:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e47665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4766c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078443:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.078444:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.078445:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.078488:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078502:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.078511:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599078272:0@lo:104: 00000100:00100000:3.0:1784583826.078532:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583826.078550:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078272 00000100:00100000:3.0:1784583826.078553:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078272 00000100:00100000:3.0:1784583826.078570:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583826.078575:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599078272:12345-0@lo:104: 00010000:00010000:3.0:1784583826.078582:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078610:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784583826.078615:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:10387:x1871271599078272:12345-0@lo:104: Request processed in 41us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.078621:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1784583826.078634:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583826.078638:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078644:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583826.078647:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078653:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583826.078659:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583826.078670:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784583826.078689:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078695:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583826.078701:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078708:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4765e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.078720:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.078722:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583826.078723:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583826.078736:0:10387:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e29c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784583826.078750:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982600/0xdab2421a42e477e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e477df expref: 23 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.078761:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077504:0@lo:104: 00010000:00010000:3.0:1784583826.078771:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e476c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e476b9 expref: 22 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.078778:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077632:0@lo:104: 00000100:00100000:3.0:1784583826.078785:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599078016:0@lo:104: 00000100:00100000:3.0:1784583826.078791:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599078272:0@lo:104: 00010000:00010000:0.0:1784583826.078886:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583826.078902:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599078400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583826.078932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583826.078962:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583826.078981:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599078144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583826.079005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583826.079029:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078400 00000100:00100000:0.0:1784583826.079032:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078400 00010000:00010000:0.0:1784583826.079055:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 22 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583826.079074:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078144 00000100:00100000:0.0:1784583826.079077:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078144 00010000:00010000:0.0:1784583826.079086:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583826.079101:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784583826.079106:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3642:x1871271599078400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583826.079114:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583826.079119:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079127:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079137:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983600/0xdab2421a42e4765e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47657 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079148:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583826.079175:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3642:x1871271599078400:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583826.079181:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784583826.079194:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784583826.079200:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3642:x1871271599078144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583826.079207:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583826.079211:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 21 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079229:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 21 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079239:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216b000/0xdab2421a42e4766c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47665 expref: 21 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583826.079250:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583826.079273:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:3642:x1871271599078144:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583826.079279:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784583826.079329:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599078144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583826.079336:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599078400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784583826.085576:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583826.085668:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146048 00000100:00100000:2.0:1784583826.085676:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146048 00010000:00010000:2.0:1784583826.085712:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 10 pid: 6507 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583826.085752:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1784583826.085761:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+10:2401:x1871271580146048:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583826.085775:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583826.085780:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 10 pid: 6507 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085793:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 10 pid: 6507 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085829:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085838:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085854:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085862:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085868:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085875:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085881:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784583826.085886:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085893:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085903:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.085913:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583826.085978:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+10:2401:x1871271580146048:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583826.085995:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00010000:00010000:3.0:1784583826.091505:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1cc00/0xdab2421a42e478fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee167 expref: 9 pid: 6507 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583826.091552:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1871271599077376:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583826.091588:0:10387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.091599:0:10387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.091606:0:10387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.091611:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96400/0xdab2421a42e479c2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583826.606897:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583826.648179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583826.648267:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146176 00000100:00100000:2.0:1784583826.648278:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146176 00000100:00100000:2.0:1784583826.648339:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 249 00000100:00100000:2.0:1784583826.648349:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+9:6171:x1871271580146176:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583826.648365:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583826.648400:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee1ad expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.648429:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.648452:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583826.648462:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784583826.648547:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580146176:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 198us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583826.648554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 249 00000100:00100000:2.0:1784583826.651647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583826.652638:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146304 00000100:00100000:0.0:1784583826.652651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146304 00000100:00100000:0.0:1784583826.652711:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 250 00000100:00100000:0.0:1784583826.652720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580146304:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583826.653314:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580146304:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 591us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.653323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 250 00000100:00100000:1.0:1784583826.656375:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583826.656629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146432 00000100:00100000:0.0:1784583826.656639:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146432 00000100:00100000:2.0:1784583826.656838:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 251 00000100:00100000:2.0:1784583826.656852:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580146432:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583826.657029:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:6171:x1871271580146432:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 180us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583826.657037:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 251 00000100:00100000:1.0:1784583826.663848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583826.664528:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146560 00000100:00100000:3.0:1784583826.664539:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146560 00000100:00100000:3.0:1784583826.664597:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 252 00000100:00100000:3.0:1784583826.664607:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6726:x1871271580146560:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784583826.664781:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:6726:x1871271580146560:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 173us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583826.664791:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 252 00000100:00100000:3.0:1784583826.668664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583826.671052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146688 00000100:00100000:1.0:1784583826.671069:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146688 00000100:00100000:1.0:1784583826.671135:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:1.0:1784583826.671145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6726:x1871271580146688:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784583826.671326:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:6726:x1871271580146688:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 180us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583826.671335:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:2.0:1784583827.036649:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583827.036692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583827.036715:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147200 00000100:00100000:2.0:1784583827.036723:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147200 00000100:00100000:2.0:1784583827.036780:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784583827.036790:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580147200:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583827.036859:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580147200:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.036867:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784583827.036903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583827.037021:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00080000:2.0:1784583827.037049:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583827.037061:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146944 00000100:00100000:2.0:1784583827.037065:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146944 00000100:00100000:2.0:1784583827.037093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580146816 00000100:00100000:2.0:1784583827.037096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580146816 00000100:00100000:2.0:1784583827.037117:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583827.037123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580146944:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583827.037158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580146944:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.037165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583827.037178:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:2.0:1784583827.037185:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580146816:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583827.037209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580146816:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.037215:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00080000:2.0:1784583827.037230:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583827.037238:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583827.037293:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147072 00000100:00100000:2.0:1784583827.037296:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147072 00000100:00100000:2.0:1784583827.037323:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784583827.037329:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580147072:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583827.037542:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580147072:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 211us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.037550:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00080000:2.0:1784583827.037567:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583827.120068:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583827.120091:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599078528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583827.120154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.120210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078528 00000100:00100000:1.0:1784583827.120217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078528 00000100:00100000:1.0:1784583827.120258:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784583827.120266:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599078528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583827.120299:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583827.120350:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599078528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583827.120358:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784583827.120411:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599078528:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1784583827.373582:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583827.373604:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b30245a800 from 4 10000000:01000000:3.0:1784583827.373609:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583827.373653:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.373666:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.373677:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.373702:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.373781:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.373855:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.374100:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078656 00000100:00100000:2.0:1784583827.374107:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078656 00000100:00100000:2.0:1784583827.374158:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784583827.374167:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599078656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583827.374179:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583827.374192:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e479d0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.374223:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.374234:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.374243:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ae00, rc 0) 00000100:00100000:2.0:1784583827.374295:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599078656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.374302:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1784583827.374416:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583827.374431:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.374440:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.374524:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.374550:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.374577:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583827.374763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078784 00000100:00100000:1.0:1784583827.374768:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078784 00000100:00100000:1.0:1784583827.374801:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784583827.374809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599078784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583827.374929:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599078784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583827.374936:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1784583827.375245:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.375274:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.375326:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.375386:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583827.375673:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599078912 00000100:00100000:0.0:1784583827.375678:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599078912 00000100:00100000:0.0:1784583827.375714:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784583827.375731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599078912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583827.375832:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599078912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583827.375841:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1784583827.375933:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599078912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583827.377157:0:10456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10456:1871271599079040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.377219:0:10456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583827.377589:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079040 00000100:00100000:2.0:1784583827.377602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079040 00000100:00100000:2.0:1784583827.377650:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784583827.377660:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10456:x1871271599079040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.377981:0:10456:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82af00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.378132:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10456:x1871271599079040:12345-0@lo:502:llog_process_th.0 Request processed in 473us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.378140:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784583827.378222:0:10456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10456:1871271599079040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.378248:0:10456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583827.378256:0:10456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.378258:0:10456:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784583827.378264:0:10456:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b30245a800 00000020:00000080:1.0:1784583827.378267:0:10456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784583827.378625:0:10456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10456:1871271599079168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.378668:0:10456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.378748:0:10456:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82af00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.379568:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079168 00000100:00100000:2.0:1784583827.379576:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079168 00000100:00100000:3.0:1784583827.382395:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784583827.382408:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10456:x1871271599079168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.382948:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:10456:x1871271599079168:12345-0@lo:502:llog_process_th.0 Request processed in 542us (4279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.382958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784583827.384143:0:10456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10456:1871271599079168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.384182:0:10456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583827.384195:0:10456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.384197:0:10456:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784583827.384201:0:10456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784583827.385392:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784583827.385450:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784583827.385461:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.385522:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583827.385532:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784583827.385534:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b43e967000 from 4 10000000:01000000:2.0:1784583827.385537:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784583827.385570:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.385578:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.385588:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583827.385611:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784583827.385675:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583827.385824:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40240 going to sleep for 11 seconds 00000100:00100000:1.0:1784583827.385983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079296 00000100:00100000:1.0:1784583827.385991:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079296 00000100:00100000:1.0:1784583827.386080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784583827.386089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599079296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583827.386102:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583827.386115:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e479de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.386137:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e479de expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.386147:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479de expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.386155:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cfe00, rc 0) 00000100:00100000:1.0:1784583827.386207:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583827.386214:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784583827.386287:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583827.386301:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.386312:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583827.386370:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583827.386400:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583827.387005:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40240 going to sleep for 11 seconds 00000100:00100000:3.0:1784583827.387040:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079424 00000100:00100000:3.0:1784583827.387046:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079424 00000100:00100000:3.0:1784583827.387074:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784583827.387081:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.387201:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.387209:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784583827.387248:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.387283:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.387329:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.387348:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784583827.387363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079552 00000100:00100000:3.0:1784583827.387366:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079552 00000100:00100000:3.0:1784583827.387389:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784583827.387397:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.387497:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.387503:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784583827.387546:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.387980:0:10459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10459:1871271599079680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.388018:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.388039:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079680 00000100:00100000:3.0:1784583827.388042:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079680 00000100:00100000:3.0:1784583827.388063:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784583827.388070:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10459:x1871271599079680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.388136:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10459:x1871271599079680:12345-0@lo:502:llog_process_th.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.388143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784583827.388178:0:10459:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caed840 going to sleep for 11 seconds 00000100:00100000:3.0:1784583827.388191:0:10459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10459:1871271599079680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784583827.388211:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784583827.388220:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583827.388222:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784583827.388228:0:10459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b43e967000 00000020:00000080:3.0:1784583827.388231:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784583827.388684:0:10459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10459:1871271599079808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.389136:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.389210:0:10459:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.389251:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079808 00000100:00100000:2.0:1784583827.389255:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079808 00000100:00100000:2.0:1784583827.389318:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784583827.389327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10459:x1871271599079808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583827.389441:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:10459:x1871271599079808:12345-0@lo:502:llog_process_th.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.389448:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784583827.389540:0:10459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10459:1871271599079808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784583827.389561:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784583827.389567:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784583827.389569:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784583827.389573:0:10459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784583827.389631:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784583827.389651:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583827.389665:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.389676:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583827.389687:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583827.389690:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b42ba2f000 from 4 10000000:01000000:3.0:1784583827.389692:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583827.389726:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.389735:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.389752:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.389767:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.389795:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.390145:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caed840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583827.390241:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599079936 00000100:00100000:1.0:1784583827.390247:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599079936 00000100:00100000:1.0:1784583827.390273:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784583827.390280:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599079936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583827.390289:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583827.390304:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e479ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.390327:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e479ec expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.390337:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479ec expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583827.390345:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce400, rc 0) 00000100:00100000:1.0:1784583827.390421:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599079936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583827.390427:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784583827.391035:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599079936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583827.391051:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.391061:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.391117:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.391157:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.391223:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caed840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583827.391256:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080064 00000100:00100000:1.0:1784583827.391261:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080064 00000100:00100000:1.0:1784583827.391332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784583827.391339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599080064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583827.391440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599080064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583827.391447:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784583827.391544:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.391571:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.391608:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.391690:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caed840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.391724:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080192 00000100:00100000:2.0:1784583827.391728:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080192 00000100:00100000:2.0:1784583827.391816:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784583827.391823:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599080192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583827.392043:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599080192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.392050:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784583827.392236:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583827.392992:0:10460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10460:1871271599080320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.393039:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.393404:0:10460:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a600 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.393707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080320 00000100:00100000:2.0:1784583827.393894:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080320 00000100:00100000:3.0:1784583827.394064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784583827.394074:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10460:x1871271599080320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.394196:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10460:x1871271599080320:12345-0@lo:502:llog_process_th.0 Request processed in 122us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.394204:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784583827.394373:0:10460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10460:1871271599080320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.394405:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583827.394414:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.394416:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784583827.394423:0:10460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b42ba2f000 00000020:00000080:1.0:1784583827.394426:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784583827.394522:0:10460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10460:1871271599080448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.394566:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.394602:0:10460:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42062c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784583827.396302:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080448 00000100:00100000:3.0:1784583827.396314:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080448 00000100:00100000:3.0:1784583827.396365:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784583827.396376:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10460:x1871271599080448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583827.396545:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:10460:x1871271599080448:12345-0@lo:502:llog_process_th.0 Request processed in 171us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.396553:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784583827.396881:0:10460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10460:1871271599080448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.396910:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583827.396919:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.396921:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784583827.396925:0:10460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784583827.397132:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784583827.397153:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583827.397163:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.397173:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583827.397189:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583827.397192:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b418942800 from 4 10000000:01000000:3.0:1784583827.397194:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583827.397219:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.397226:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.397234:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.397252:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.397286:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.397315:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583827.397367:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080576 00000100:00100000:0.0:1784583827.397373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080576 00000100:00100000:0.0:1784583827.397409:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784583827.397855:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599080576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583827.397986:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583827.398001:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e479fa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583827.398029:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e479fa expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583827.398041:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479fa expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583827.398048:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:0.0:1784583827.398097:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599080576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583827.398104:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784583827.398206:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583827.398220:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583827.398229:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583827.398283:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.398310:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.398341:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583827.398385:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080704 00000100:00100000:0.0:1784583827.398389:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080704 00000100:00100000:0.0:1784583827.398451:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784583827.398459:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599080704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583827.398572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599080704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583827.398578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784583827.398639:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583827.398666:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583827.398705:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583827.402252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080832 00000100:00100000:3.0:1784583827.402266:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080832 00000100:00100000:3.0:1784583827.402320:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784583827.402330:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599080832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583827.402646:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599080832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583827.402654:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784583827.404697:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.404729:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599080832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583827.405270:0:10462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10462:1871271599080960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.405331:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.405584:0:10462:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42062ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.407150:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599080960 00000100:00100000:2.0:1784583827.407161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599080960 00000100:00100000:2.0:1784583827.407222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784583827.407231:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:10462:x1871271599080960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583827.407397:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:10462:x1871271599080960:12345-0@lo:502:llog_process_th.0 Request processed in 166us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.407404:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784583827.407720:0:10462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10462:1871271599080960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.407819:0:10462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583827.407828:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.407831:0:10462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784583827.407838:0:10462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b418942800 00000020:00000080:1.0:1784583827.407840:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784583827.407918:0:10462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10462:1871271599081088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583827.407976:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583827.408019:0:10462:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583827.408171:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081088 00000100:00100000:2.0:1784583827.408176:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081088 00000100:00100000:2.0:1784583827.408211:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1784583827.408218:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:10462:x1871271599081088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583827.408393:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:10462:x1871271599081088:12345-0@lo:502:llog_process_th.0 Request processed in 175us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583827.408401:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784583827.408554:0:10462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:10462:1871271599081088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583827.408642:0:10462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583827.408647:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583827.408649:0:10462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784583827.408652:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784583827.408865:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784583827.408906:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784583827.408916:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583827.408927:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583827.630592:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583828.654144:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583828.654171:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599081344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583828.654265:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583828.654338:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583828.654347:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599081216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583828.654372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583828.654529:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583828.656557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784583828.656574:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599081600:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.656633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583828.656665:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599081472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583828.656666:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081344 00000100:00100000:3.0:1784583828.656674:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081344 00000100:00100000:2.0:1784583828.656685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583828.656702:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599081984:0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.656717:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081216 00000100:00100000:3.0:1784583828.656720:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081216 00000100:00100000:2.0:1784583828.656722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583828.656753:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599082496:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.656774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583828.656790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784583828.656795:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599082112:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.656817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.656830:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599081856:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.656835:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599082624:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.656853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.656855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.656868:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599082368:0@lo:400:kworker.0 00000100:00080000:2.0:1784583828.656876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784583828.656879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583828.656886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.656907:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599082880:0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.656930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.656948:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784583828.656962:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599081728:0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.656984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583828.657010:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081472 00000100:00100000:3.0:1784583828.657013:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081472 00000100:00100000:2.0:1784583828.657019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081984 00000100:00100000:2.0:1784583828.657022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081984 00000100:00100000:2.0:1784583828.657049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082624 00000100:00100000:3.0:1784583828.657052:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784583828.657052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082624 00000100:00100000:3.0:1784583828.657059:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599081344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583828.657064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082368 00000100:00100000:2.0:1784583828.657066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082368 00000100:00100000:2.0:1784583828.657077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784583828.657082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599081984:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784583828.657087:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583828.657122:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599081344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583828.657122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599081984:12345-0@lo:400:kworker.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.657129:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784583828.657134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784583828.657144:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784583828.657144:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583828.657150:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599081216:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583828.657150:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599082624:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784583828.657163:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583828.657176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599082624:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583828.657181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583828.657184:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599081216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (2812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.657189:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784583828.657191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784583828.657196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599082368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.657198:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784583828.657203:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599081472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583828.657210:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583828.657219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599082368:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583828.657225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784583828.657226:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599081472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.657237:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784583828.657241:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082496 00000100:00100000:2.0:1784583828.657244:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082496 00000100:00080000:3.0:1784583828.657252:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583828.657254:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583828.657257:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583828.657261:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082880 00000100:00100000:2.0:1784583828.657264:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082880 00000100:00100000:0.0:1784583828.657340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081600 00000100:00100000:0.0:1784583828.657345:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081600 00000100:00100000:0.0:1784583828.657372:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784583828.657377:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599081600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583828.657411:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599081600:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583828.657416:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:0.0:1784583828.657494:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8a80 x1871271599081216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583828.657512:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599081216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583828.657545:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082112 00000100:00100000:0.0:1784583828.657548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082112 00000100:00100000:0.0:1784583828.657564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081856 00000100:00100000:0.0:1784583828.657566:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081856 00000100:00100000:0.0:1784583828.657577:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784583828.657582:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599082112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583828.657611:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599082112:12345-0@lo:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583828.657617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784583828.657626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784583828.657631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599081856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583828.657651:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599081856:12345-0@lo:400:kworker.0 Request processed in 20us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583828.657662:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1784583828.657691:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a34e00 x1871271599081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583828.657703:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599081344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583828.657714:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583828.657718:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599083008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583828.664683:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599082112:0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.664706:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599082624:0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.664718:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599081984:0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.664738:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599081600:0@lo:400:kworker.0 00010000:00080000:3.0:1784583828.664753:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c5f80 x1871271599081472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583828.664773:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599081472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583828.664855:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784583828.664871:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599082496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.664963:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599082496:12345-0@lo:400:kworker.0 Request processed in 91us (8178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.664971:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784583828.664999:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784583828.665012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599081728 00000100:00100000:3.0:1784583828.665017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599081728 00000100:00100000:2.0:1784583828.665022:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784583828.665029:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599082880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583828.665057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784583828.665063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599081728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.665065:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599082880:12345-0@lo:400:kworker.0 Request processed in 37us (8135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583828.665071:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784583828.665094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599081728:12345-0@lo:400:kworker.0 Request processed in 31us (8109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.665100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1784583828.665104:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efabb80 x1871271599082496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583828.665112:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599082496:0@lo:400:kworker.0 00000100:00100000:0.0:1784583828.665381:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583828.665568:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083008 00000100:00100000:3.0:1784583828.665573:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083008 00000100:00100000:3.0:1784583828.665608:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784583828.665615:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599083008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583828.665629:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583828.665675:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599083008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583828.665682:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1784583828.665753:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a36d80 x1871271599083008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583828.665768:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599083008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583828.667638:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599081728:0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.667652:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599082240:0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.667701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.668553:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599082752:0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.668600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583828.668745:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599081856:0@lo:400:kworker.0 00010000:00080000:1.0:1784583828.668762:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efaaa00 x1871271599082368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583828.668786:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599082368:0@lo:400:kworker.0 00010000:00080000:1.0:1784583828.668802:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cf480 x1871271599082880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583828.668810:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599082880:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.671613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082240 00000100:00100000:2.0:1784583828.671627:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082240 00000100:00100000:2.0:1784583828.671727:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599082752 00000100:00100000:1.0:1784583828.671845:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784583828.671858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583828.671942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599082240:12345-0@lo:400:kworker.0 Request processed in 86us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583828.671949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784583828.672008:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599082240:0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.672076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599082752 00000100:00100000:2.0:1784583828.672112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784583828.672119:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599082752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583828.672156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599082752:12345-0@lo:400:kworker.0 Request processed in 38us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583828.672162:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1784583828.672242:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cd180 x1871271599082752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583828.672254:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599082752:0@lo:400:kworker.0 00000100:00080000:0.0:1784583828.672318:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583828.672322:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583829.167556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583829.174248:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599083136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784583829.174661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583829.177343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083136 00000100:00100000:0.0:1784583829.177358:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083136 00000100:00100000:0.0:1784583829.177460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784583829.177490:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599083136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583829.177523:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583829.177593:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599083136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583829.177599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784583829.177682:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599083136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583829.677772:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583830.701871:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784583831.381680:0:10687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1784583831.726581:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583832.147990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583832.148152:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583832.148176:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583832.148207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583832.148229:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583832.148253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147584 00000100:00100000:0.0:1784583832.148261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147584 00000100:00100000:0.0:1784583832.148311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147456 00000100:00100000:0.0:1784583832.148314:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147456 00000100:00100000:0.0:1784583832.148334:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:0.0:1784583832.148343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147584:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583832.149234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1784583832.149250:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580147456:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583832.149337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580147456:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 91us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583832.149344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147584:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 999us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583832.149351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1784583832.149523:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147840 00000100:00100000:2.0:1784583832.149529:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147840 00000100:00100000:2.0:1784583832.149559:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147712 00000100:00100000:2.0:1784583832.149562:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147712 00000100:00100000:2.0:1784583832.149582:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1784583832.149588:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147840:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583832.149619:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147840:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583832.149625:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1784583832.149636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:2.0:1784583832.149652:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147712:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583832.149676:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580147712:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583832.149682:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784583832.151305:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00080000:0.0:1784583832.151346:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583832.151350:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583832.151362:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583832.151364:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583832.151698:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147328 00000100:00100000:1.0:1784583832.151706:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147328 00000100:00100000:1.0:1784583832.151787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 275 00000100:00100000:1.0:1784583832.151798:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2398:x1871271580147328:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583832.151871:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2398:x1871271580147328:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 74us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583832.151878:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 275 00000100:00100000:0.0:1784583832.239342:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583832.239365:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599083264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583832.239425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583832.239505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083264 00000100:00100000:0.0:1784583832.239512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083264 00000100:00100000:0.0:1784583832.239557:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784583832.239566:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599083264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583832.239597:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583832.239638:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599083264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583832.239645:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784583832.239689:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599083264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583832.750968:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583833.773685:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599083776:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.773749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.773792:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599084288:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.773815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.773837:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599084800:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.773855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.773878:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784583833.773883:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599083392:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.773909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.773944:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599083904:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.773968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.773985:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599084416:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774020:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599084928:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774062:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599083520:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774138:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599084032:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774176:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599084544:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774209:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784583833.774214:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599083648:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774249:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599084160:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599084672:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.774317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083776 00000100:00100000:3.0:1784583833.774323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083776 00000100:00100000:3.0:1784583833.774356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083520 00000100:00100000:3.0:1784583833.774359:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083520 00000100:00100000:3.0:1784583833.774370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084032 00000100:00100000:3.0:1784583833.774372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084032 00000100:00100000:3.0:1784583833.774394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084544 00000100:00100000:3.0:1784583833.774397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084544 00000100:00100000:3.0:1784583833.774408:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084160 00000100:00100000:3.0:1784583833.774410:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084160 00000100:00100000:3.0:1784583833.774420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084672 00000100:00100000:3.0:1784583833.774422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084672 00000100:00100000:3.0:1784583833.774436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784583833.774443:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599083776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599083776:12345-0@lo:400:kworker.0 Request processed in 68us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784583833.774543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784583833.774549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599083520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774579:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599083520:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784583833.774596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784583833.774601:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774623:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599084032:12345-0@lo:400:kworker.0 Request processed in 22us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784583833.774638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784583833.774643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599084544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599084544:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774672:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784583833.774682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784583833.774687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599084160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774709:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599084160:12345-0@lo:400:kworker.0 Request processed in 22us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774715:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784583833.774725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784583833.774730:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599084672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599084672:12345-0@lo:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784583833.774782:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084288 00000100:00100000:3.0:1784583833.774786:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084288 00000100:00100000:3.0:1784583833.774802:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084800 00000100:00100000:3.0:1784583833.774804:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084800 00000100:00100000:3.0:1784583833.774814:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084416 00000100:00100000:3.0:1784583833.774817:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084416 00000100:00100000:3.0:1784583833.774826:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599084928 00000100:00100000:3.0:1784583833.774828:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599084928 00000100:00100000:3.0:1784583833.774838:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784583833.774844:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599084288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774872:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599084288:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774878:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784583833.774888:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583833.774893:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599084800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774916:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599084800:12345-0@lo:400:kworker.0 Request processed in 23us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774934:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784583833.774944:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784583833.774949:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.774988:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599084416:12345-0@lo:400:kworker.0 Request processed in 39us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.774994:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784583833.775005:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583833.775011:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599084928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775045:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599084928:12345-0@lo:400:kworker.0 Request processed in 34us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.775052:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784583833.775073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083392 00000100:00100000:3.0:1784583833.775077:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083392 00000100:00100000:3.0:1784583833.775102:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784583833.775109:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599083392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775138:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599083392:12345-0@lo:400:kworker.0 Request processed in 29us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.775144:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784583833.775170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083904 00000100:00100000:3.0:1784583833.775174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083904 00000100:00100000:3.0:1784583833.775189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599083648 00000100:00100000:3.0:1784583833.775192:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599083648 00000100:00100000:3.0:1784583833.775202:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784583833.775207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599083904:12345-0@lo:400:kworker.0 Request processed in 28us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.775242:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784583833.775253:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784583833.775259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599083648:12345-0@lo:400:kworker.0 Request processed in 24us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.775289:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1784583833.775322:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583833.775326:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583833.775328:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583833.775336:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583833.775368:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599083648:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775382:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cc000 x1871271599084160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775392:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599084160:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775401:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cf800 x1871271599084672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775410:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599084672:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775419:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599083520:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775427:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599084032:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599084544:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775488:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599083392:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775498:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599083904:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775507:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7ce680 x1871271599084416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775515:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599084416:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775524:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cd500 x1871271599084928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775531:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599084928:0@lo:400:kworker.0 00000100:00100000:3.0:1784583833.775540:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599083776:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cf100 x1871271599084288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775563:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599084288:0@lo:400:kworker.0 00010000:00080000:3.0:1784583833.775575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cd880 x1871271599084800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.775582:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599084800:0@lo:400:kworker.0 00000100:00100000:2.0:1784583833.775770:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599085056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583833.775801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583833.775832:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085056 00000100:00100000:2.0:1784583833.775836:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085056 00000100:00100000:2.0:1784583833.775863:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784583833.775870:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599085056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583833.775891:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583833.775936:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599085056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583833.775944:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1784583833.775972:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c4000 x1871271599085056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583833.775984:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599085056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784583833.777065:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583833.777080:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583833.777091:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583833.777143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583833.777175:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085184 00000100:00100000:0.0:1784583833.777179:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085184 00000100:00100000:0.0:1784583833.777211:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784583833.777219:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599085184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784583833.777233:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583833.777266:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599085184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583833.777272:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1784583833.777302:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a34380 x1871271599085184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583833.777316:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583833.777432:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583833.777441:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599085312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583833.777488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583833.777513:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085312 00000100:00100000:3.0:1784583833.777517:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085312 00000100:00100000:3.0:1784583833.777542:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784583833.777548:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599085312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583833.777563:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583833.777593:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599085312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583833.777599:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1784583833.777620:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412a680 x1871271599085312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583833.777632:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599085312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583833.777749:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599085440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583833.777773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583833.777831:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085440 00000100:00100000:1.0:1784583833.777835:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085440 00000100:00100000:1.0:1784583833.777866:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784583833.777872:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599085440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583833.777882:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583833.777914:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599085440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583833.777930:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1784583833.777953:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30404e680 x1871271599085440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583833.777966:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599085440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583834.288119:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583834.288140:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599085568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583834.288203:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583834.288264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085568 00000100:00100000:0.0:1784583834.288271:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085568 00000100:00100000:0.0:1784583834.288311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784583834.288319:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599085568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583834.288349:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583834.288393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599085568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583834.288401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784583834.288446:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599085568:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583834.799111:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784583835.575700:0:10931:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing yml_node 00010000:00010000:0.0:1784583835.821629:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583836.845695:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583837.271594:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583837.271636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583837.271668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583837.271683:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580147968 00000100:00100000:1.0:1784583837.271693:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580147968 00000100:00100000:1.0:1784583837.271750:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 277 00000100:00100000:1.0:1784583837.271759:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580147968:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583837.271834:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580147968:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583837.271837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148224 00000100:00100000:3.0:1784583837.271843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148224 00000100:00100000:1.0:1784583837.271844:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 277 00000100:00080000:1.0:1784583837.271944:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583837.277618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148096 00000100:00100000:3.0:1784583837.277633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148096 00000100:00080000:1.0:1784583837.277759:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583837.284777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:0.0:1784583837.284819:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580148224:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583837.284875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1784583837.284888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580148096:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583837.284914:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580148224:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 122us (13275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583837.284923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:3.0:1784583837.285723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580148096:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 51us (13266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583837.285735:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:2.0:1784583837.291046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583837.291088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583837.291166:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148352 00000100:00100000:3.0:1784583837.291172:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148480 00000100:00100000:0.0:1784583837.291176:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148352 00000100:00100000:3.0:1784583837.291178:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148480 00000100:00100000:3.0:1784583837.291263:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1784583837.291272:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:3.0:1784583837.291275:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2397:x1871271580148480:12345-192.168.203.51@tcp:9:kworker.0 00000100:00100000:0.0:1784583837.291286:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2397:x1871271580148352:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:0.0:1784583837.291310:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47913 00000020:00000080:3.0:1784583837.291312:0:8428:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4791a 00000100:00080000:0.0:1784583837.291323:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b43eb05000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1784583837.291324:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b42f7dd000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1784583837.291379:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784583837.291383:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1784583837.291451:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784583837.291650:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+2:2397:x1871271580148352:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 361us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583837.291659:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:1.0:1784583837.294605:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583837.294960:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784583837.297769:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784583837.297964:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+2:2397:x1871271580148480:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 6688us (6870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583837.297976:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784583837.357652:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583837.357677:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599085696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583837.357757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583837.363951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085696 00000100:00100000:0.0:1784583837.363966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085696 00000100:00100000:0.0:1784583837.364038:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784583837.364048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599085696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583837.364086:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583837.364175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599085696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583837.364183:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784583837.365185:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599085696:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583837.870145:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583838.896308:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599085952:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896432:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599086464:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896502:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599086976:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896543:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599087488:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896586:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1784583838.896593:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599085824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583838.896728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896756:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599086336:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896794:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599086848:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896824:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599087360:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896879:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599086080:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896926:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599086592:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896955:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599087104:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.896971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.896986:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784583838.896991:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599086208:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.897030:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599086720:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.897064:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599087232:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.897104:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085952 00000100:00100000:1.0:1784583838.897110:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085952 00000100:00100000:1.0:1784583838.897150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784583838.897158:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599085952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897203:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599085952:12345-0@lo:400:kworker.0 Request processed in 46us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897210:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784583838.897409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086464 00000100:00100000:1.0:1784583838.897414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086464 00000100:00100000:1.0:1784583838.897430:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086208 00000100:00100000:1.0:1784583838.897433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086208 00000100:00100000:1.0:1784583838.897445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784583838.897451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897512:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599086464:12345-0@lo:400:kworker.0 Request processed in 60us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897519:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784583838.897531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784583838.897536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599086208:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784583838.897595:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086976 00000100:00100000:1.0:1784583838.897599:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086976 00000100:00100000:1.0:1784583838.897779:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087488 00000100:00100000:1.0:1784583838.897783:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087488 00000100:00100000:1.0:1784583838.897795:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086848 00000100:00100000:1.0:1784583838.897797:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086848 00000100:00100000:1.0:1784583838.897808:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087360 00000100:00100000:1.0:1784583838.897810:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087360 00000100:00100000:1.0:1784583838.897823:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784583838.897829:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897861:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599086976:12345-0@lo:400:kworker.0 Request processed in 32us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897867:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784583838.897879:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784583838.897894:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897922:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599087488:12345-0@lo:400:kworker.0 Request processed in 38us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897928:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784583838.897938:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784583838.897944:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599086848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.897968:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599086848:12345-0@lo:400:kworker.0 Request processed in 24us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.897974:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784583838.897984:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784583838.897990:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.898015:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599087360:12345-0@lo:400:kworker.0 Request processed in 25us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583838.898032:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784583838.902557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086336 00000100:00100000:3.0:1784583838.902570:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086336 00000100:00100000:3.0:1784583838.902608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086080 00000100:00100000:3.0:1784583838.902612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086080 00000100:00100000:3.0:1784583838.902624:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086592 00000100:00100000:3.0:1784583838.902626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086592 00000100:00100000:3.0:1784583838.902644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087104 00000100:00100000:3.0:1784583838.902646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087104 00000100:00100000:3.0:1784583838.902658:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599086720 00000100:00100000:3.0:1784583838.902661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599086720 00000100:00100000:3.0:1784583838.902670:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087232 00000100:00100000:3.0:1784583838.902672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087232 00000100:00100000:3.0:1784583838.902689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784583838.902698:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599086336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.902796:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599086336:12345-0@lo:400:kworker.0 Request processed in 99us (6014us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.902804:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784583838.902821:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784583838.902827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.902854:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599086080:12345-0@lo:400:kworker.0 Request processed in 28us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.902860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784583838.902872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784583838.902877:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599086592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.902917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599086592:12345-0@lo:400:kworker.0 Request processed in 39us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.902923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784583838.902935:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784583838.902941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.902968:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599087104:12345-0@lo:400:kworker.0 Request processed in 27us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.902973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784583838.902984:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784583838.902989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599086720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.903014:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599086720:12345-0@lo:400:kworker.0 Request processed in 25us (5959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.903020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784583838.903029:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784583838.903035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599087232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583838.903070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599087232:12345-0@lo:400:kworker.0 Request processed in 35us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.903076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784583838.903113:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599085824 00000100:00100000:3.0:1784583838.903117:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599085824 00000100:00100000:3.0:1784583838.903148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784583838.903154:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599085824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583838.903175:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583838.903204:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599085824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (6477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583838.903209:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784583838.905314:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599087872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583838.905371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583838.905456:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583838.906038:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087872 00000100:00100000:2.0:1784583838.906166:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087872 00000100:00100000:2.0:1784583838.906216:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784583838.906982:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599087872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583838.907019:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784583838.907207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583838.907213:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583838.907215:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583838.907228:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583838.907257:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583838.907306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.907348:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583838.907355:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583838.907380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583838.907420:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599086208:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303853480 x1871271599086720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907446:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599086720:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907459:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3040d1c00 x1871271599087232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907496:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599087232:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.907509:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599086080:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.907520:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599086592:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.907529:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599087104:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907567:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412b800 x1871271599085824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907581:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599085824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583838.907603:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599086336:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907613:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303850380 x1871271599086848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907622:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599086848:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907631:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3040d0380 x1871271599087360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907639:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599087360:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.907650:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599085952:0@lo:400:kworker.0 00000100:00100000:1.0:1784583838.907659:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599086464:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907669:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3040d0a80 x1871271599086976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907676:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599086976:0@lo:400:kworker.0 00010000:00080000:1.0:1784583838.907686:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3040d2300 x1871271599087488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.907693:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599087488:0@lo:400:kworker.0 00000100:00100000:0.0:1784583838.908105:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087744 00000100:00100000:0.0:1784583838.908112:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087744 00000100:00100000:0.0:1784583838.908145:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599087616 00000100:00100000:0.0:1784583838.908148:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599087616 00000100:00100000:0.0:1784583838.908165:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784583838.908172:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599087744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583838.908186:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583838.908237:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599087744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583838.908244:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784583838.908259:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784583838.908265:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599087616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784583838.908274:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583838.908300:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599087616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583838.908307:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1784583838.908515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304129880 x1871271599087616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.908529:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599087616:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784583838.908561:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a37480 x1871271599087744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583838.908575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583838.908994:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599087872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2015us (3621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583838.909002:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1784583838.909125:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a37b80 x1871271599087872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583838.909139:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599087872:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1784583838.957836:0:11114:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00000100:00100000:2.0:1784583839.417702:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599088000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784583839.417781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583839.417964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088000 00000100:00100000:1.0:1784583839.417972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088000 00000100:00100000:1.0:1784583839.418020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784583839.418029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599088000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784583839.418060:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784583839.418104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599088000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583839.418111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784583839.418239:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599088000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583839.917650:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784583840.930686:0:11211:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00010000:00010000:0.0:1784583840.941592:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583841.965629:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583842.391591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583842.391635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583842.391675:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583842.391765:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148608 00000100:00100000:3.0:1784583842.391775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148608 00000100:00100000:1.0:1784583842.391777:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148864 00000100:00100000:1.0:1784583842.391783:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148864 00000100:00100000:3.0:1784583842.391834:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 279 00000100:00100000:0.0:1784583842.391897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148736 00000100:00100000:0.0:1784583842.391902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148736 00000100:00100000:3.0:1784583842.391927:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:2398:x1871271580148608:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583842.391994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+10:2398:x1871271580148608:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 150us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583842.392001:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 279 00000100:00100000:1.0:1784583842.392197:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:1.0:1784583842.392205:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580148864:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583842.392245:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580148864:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 41us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583842.392252:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00080000:2.0:1784583842.396046:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583842.396057:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583842.397882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1784583842.397900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580148736:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583842.397984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580148736:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 91us (6307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583842.397992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:3.0:1784583842.477632:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583842.477655:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599088128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583842.477725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583842.477802:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088128 00000100:00100000:1.0:1784583842.477810:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088128 00000100:00100000:1.0:1784583842.477860:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784583842.477891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599088128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583842.477925:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583842.477985:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599088128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583842.477992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784583842.478067:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599088128:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1784583842.795098:0:11309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00010000:00010000:0.0:1784583842.990188:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784583842.991948:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583842.991956:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b43eb03000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:0.0:1784583842.992177:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb03000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-OST0000 00000020:00000080:0.0:1784583842.992245:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43eb05000 for lustre-OST0000 00000001:00100000:3.0:1784583842.992409:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583842.992415:0:9507:0:(genops.c:906:class_export_put()) final put ffff98b42f7d9000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:1.0:1784583842.992537:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b42f7d9000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-OST0001 00000020:00000080:1.0:1784583842.992653:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b42f7dd000 for lustre-OST0001 00000001:02000400:3.0:1784583843.963924:0:11357:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 20 17:44:03 EDT 2026 00000100:00100000:1.0:1784583844.013696:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599088256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583844.013763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.013999:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088256 00000100:00100000:1.0:1784583844.014006:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088256 00000100:00100000:1.0:1784583844.014058:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583844.014066:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599088256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583844.014093:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583844.014135:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599088256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.014141:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583844.014163:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599088384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583844.014186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014204:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599088896:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014240:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089408:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014283:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089920:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014329:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784583844.014335:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599088512:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014380:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089024:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.014417:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599089536:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784583844.014464:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583844.014510:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088384 00000100:00100000:1.0:1784583844.014515:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088384 00000100:00100000:1.0:1784583844.014549:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784583844.014559:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599088384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583844.014581:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583844.014622:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599088384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.014628:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784583844.014645:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088896 00000100:00100000:1.0:1784583844.014648:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088896 00000100:00100000:1.0:1784583844.014670:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089536 00000100:00100000:1.0:1784583844.014674:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089536 00000100:00100000:1.0:1784583844.014701:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784583844.014710:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599088896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014754:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599088896:12345-0@lo:400:kworker.0 Request processed in 44us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.014763:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784583844.014779:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784583844.014788:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014838:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599089536:12345-0@lo:400:kworker.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.014847:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784583844.014885:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089408 00000100:00100000:1.0:1784583844.014891:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089408 00000100:00100000:1.0:1784583844.014921:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089920 00000100:00100000:1.0:1784583844.014924:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089920 00000100:00100000:1.0:1784583844.014944:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784583844.014951:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.014987:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089408:12345-0@lo:400:kworker.0 Request processed in 38us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.014993:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784583844.015128:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784583844.015134:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015160:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089920:12345-0@lo:400:kworker.0 Request processed in 26us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015165:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784583844.015182:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088512 00000100:00100000:1.0:1784583844.015185:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088512 00000100:00100000:1.0:1784583844.015205:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784583844.015210:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599088512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015239:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599088512:12345-0@lo:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015244:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784583844.015267:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089024 00000100:00100000:1.0:1784583844.015270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089024 00000100:00100000:1.0:1784583844.015293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784583844.015306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599089024:12345-0@lo:400:kworker.0 Request processed in 32us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015341:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784583844.015366:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599088640:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015408:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599089152:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015439:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599089664:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015489:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784583844.015495:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599088768:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015530:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599089280:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015558:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599089792:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583844.015597:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088640 00000100:00100000:1.0:1784583844.015600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088640 00000100:00100000:1.0:1784583844.015616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089152 00000100:00100000:1.0:1784583844.015619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089152 00000100:00100000:1.0:1784583844.015631:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089664 00000100:00100000:1.0:1784583844.015633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089664 00000100:00100000:1.0:1784583844.015643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089280 00000100:00100000:1.0:1784583844.015645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089280 00000100:00100000:1.0:1784583844.015657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784583844.015662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599088640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599088640:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784583844.015719:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784583844.015725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599089152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015748:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599089152:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784583844.015762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784583844.015767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599089664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599089664:12345-0@lo:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784583844.015806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784583844.015812:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599089280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.015835:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599089280:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.015841:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1784583844.015870:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583844.015876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784583844.015878:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583844.015880:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784583844.015907:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304129f80 x1871271599088256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.015925:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599088256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583844.015959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599088768 00000100:00100000:1.0:1784583844.015963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599088768 00000100:00100000:1.0:1784583844.015983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784583844.015987:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599088768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599088768:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.016020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784583844.016049:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599088768:0@lo:400:kworker.0 00010000:00080000:1.0:1784583844.016058:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab2a00 x1871271599089280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016066:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599089280:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016075:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599088640:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016083:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599089152:0@lo:400:kworker.0 00010000:00080000:1.0:1784583844.016091:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab2300 x1871271599089664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016098:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599089664:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016130:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599088512:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016139:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089024:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016149:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599089536:0@lo:400:kworker.0 00010000:00080000:1.0:1784583844.016159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab1500 x1871271599088384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016170:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599088384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583844.016188:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599088896:0@lo:400:kworker.0 00010000:00080000:1.0:1784583844.016198:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab1c00 x1871271599089408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016205:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089408:0@lo:400:kworker.0 00010000:00080000:1.0:1784583844.016214:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab0000 x1871271599089920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016220:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599089920:0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016245:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599089792 00000100:00100000:1.0:1784583844.016248:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599089792 00000100:00100000:1.0:1784583844.016270:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784583844.016275:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583844.016305:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599089792:12345-0@lo:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583844.016311:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1784583844.016322:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784583844.016336:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab0700 x1871271599089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583844.016344:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599089792:0@lo:400:kworker.0 00000100:00100000:3.0:1784583844.020255:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583844.020276:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599090176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583844.020339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583844.020380:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090176 00000100:00100000:3.0:1784583844.020386:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090176 00000100:00100000:3.0:1784583844.020439:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784583844.020447:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599090176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583844.020484:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583844.020524:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599090176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583844.020531:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1784583844.020568:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304129180 x1871271599090176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583844.020586:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599090176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583844.020609:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583844.020616:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599090048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583844.020641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583844.020662:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090048 00000100:00100000:3.0:1784583844.020673:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090048 00000100:00100000:3.0:1784583844.020696:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784583844.020701:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599090048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583844.020711:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583844.020739:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599090048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583844.020744:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784583844.020768:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412bb80 x1871271599090048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583844.020780:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599090048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784583844.025581:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583844.525652:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599090304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784583844.525716:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583844.525787:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090304 00000100:00100000:2.0:1784583844.525794:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090304 00000100:00100000:2.0:1784583844.525837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784583844.525845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599090304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583844.525887:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583844.525949:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599090304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583844.525957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784583844.525999:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599090304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583845.037590:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583846.062256:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583847.085612:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583847.508106:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583847.508149:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583847.508187:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583847.508377:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149248 00000100:00100000:0.0:1784583847.508387:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149248 00000100:00100000:0.0:1784583847.508451:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149120 00000100:00100000:0.0:1784583847.508454:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149120 00000100:00100000:0.0:1784583847.508519:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1784583847.508529:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580149248:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583847.508603:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580149248:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583847.508610:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1784583847.508625:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:0.0:1784583847.508630:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580149120:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583847.508652:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580149120:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583847.508657:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:1.0:1784583847.508717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580148992 00000100:00100000:1.0:1784583847.508721:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580148992 00000100:00100000:1.0:1784583847.508751:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 281 00000100:00100000:1.0:1784583847.508757:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580148992:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583847.508779:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:2399:x1871271580148992:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583847.508794:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 281 00000100:00080000:3.0:1784583847.509488:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583847.509494:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583847.598677:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583847.598704:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599090432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583847.598781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583847.599238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090432 00000100:00100000:2.0:1784583847.599247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090432 00000100:00100000:2.0:1784583847.599302:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784583847.599312:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599090432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583847.599435:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583847.599537:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599090432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 226us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583847.599545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784583847.599627:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599090432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583848.115777:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583849.134069:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599090560:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.134201:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090560 00000100:00100000:1.0:1784583849.134207:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090560 00000100:00100000:1.0:1784583849.134245:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784583849.134253:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599090560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134298:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599090560:12345-0@lo:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583849.134304:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784583849.134348:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599090560:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134399:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599090944:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.134493:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599091072:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.134567:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599091456:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.134613:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091456 00000100:00100000:1.0:1784583849.134617:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091456 00000100:00100000:1.0:1784583849.134652:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784583849.134658:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599091456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134702:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599091456:12345-0@lo:400:kworker.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583849.134708:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1784583849.134723:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784583849.134745:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab0e00 x1871271599091456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583849.134755:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599091456:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134786:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599091584:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.134843:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091584 00000100:00100000:1.0:1784583849.134846:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091584 00000100:00100000:1.0:1784583849.134873:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784583849.134878:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599091584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134912:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599091584:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583849.134918:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1784583849.134933:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784583849.134950:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab0e00 x1871271599091584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583849.134960:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599091584:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.134996:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599091968:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.135015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.135037:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091968 00000100:00100000:1.0:1784583849.135040:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091968 00000100:00100000:1.0:1784583849.135061:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583849.135074:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599091968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.135105:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599091968:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583849.135111:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1784583849.135125:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784583849.135139:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab2a00 x1871271599091968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583849.135148:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599091968:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.135181:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092096:0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.135203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583849.135223:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092096 00000100:00100000:1.0:1784583849.135227:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092096 00000100:00100000:1.0:1784583849.135249:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784583849.135254:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583849.135284:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092096:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583849.135290:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1784583849.135304:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784583849.135321:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab2a00 x1871271599092096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583849.135329:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092096:0@lo:400:kworker.0 00000100:00100000:0.0:1784583849.135697:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090944 00000100:00100000:0.0:1784583849.135702:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090944 00000100:00100000:0.0:1784583849.135736:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784583849.135744:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583849.135795:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599090944:12345-0@lo:400:kworker.0 Request processed in 52us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583849.135801:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784583849.135861:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599090944:0@lo:400:kworker.0 00010000:00010000:0.0:1784583849.135903:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583849.137002:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583849.137016:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583849.137056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137153:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599090688:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137201:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599091200:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137236:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599091712:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137271:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599092224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583849.137289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137307:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784583849.137313:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599090816:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137350:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599091328:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137392:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599091840:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137421:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599092352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583849.137439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.137489:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091072 00000100:00100000:2.0:1784583849.137495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091072 00000100:00100000:2.0:1784583849.137523:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090816 00000100:00100000:2.0:1784583849.137526:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090816 00000100:00100000:2.0:1784583849.137539:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784583849.137546:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599091072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137586:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599091072:12345-0@lo:400:kworker.0 Request processed in 39us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784583849.137606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784583849.137611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137641:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599090816:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784583849.137668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599090688 00000100:00100000:2.0:1784583849.137671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599090688 00000100:00100000:2.0:1784583849.137688:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091200 00000100:00100000:2.0:1784583849.137691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091200 00000100:00100000:2.0:1784583849.137714:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091712 00000100:00100000:2.0:1784583849.137717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091712 00000100:00100000:2.0:1784583849.137729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091328 00000100:00100000:2.0:1784583849.137731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091328 00000100:00100000:2.0:1784583849.137741:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599091840 00000100:00100000:2.0:1784583849.137743:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599091840 00000100:00100000:2.0:1784583849.137754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784583849.137763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599090688:12345-0@lo:400:kworker.0 Request processed in 23us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784583849.137798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583849.137801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599091200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137814:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599091200:12345-0@lo:400:kworker.0 Request processed in 14us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583849.137840:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583849.137847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599091712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599091712:12345-0@lo:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583849.137885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784583849.137890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599091328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137915:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599091328:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137919:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784583849.137929:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784583849.137935:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599091840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.137958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599091840:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.137963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784583849.137981:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092480 00000100:00100000:2.0:1784583849.137989:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092480 00000100:00100000:2.0:1784583849.138006:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092224 00000100:00100000:2.0:1784583849.138009:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092224 00000100:00100000:2.0:1784583849.138020:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092352 00000100:00100000:2.0:1784583849.138023:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092352 00000100:00100000:2.0:1784583849.138041:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583849.138046:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583849.138066:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583849.138076:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784583849.138084:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599092224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583849.138094:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583849.138095:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.138100:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583849.138111:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583849.138117:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599092352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583849.138119:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599092224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583849.138125:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00002000:00000024:2.0:1784583849.138130:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583849.138154:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599092352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583849.138160:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1784583849.138182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583849.138187:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583849.138196:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583849.138205:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599092608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583849.138231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583849.138282:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599090816:0@lo:400:kworker.0 00010000:00080000:2.0:1784583849.138296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab3480 x1871271599091328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583849.138305:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599091328:0@lo:400:kworker.0 00010000:00080000:2.0:1784583849.138314:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab1f80 x1871271599091840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583849.138329:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599091840:0@lo:400:kworker.0 00010000:00080000:2.0:1784583849.138342:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412aa00 x1871271599092352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583849.138354:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599092352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583849.138363:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599090688:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.138371:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599091200:0@lo:400:kworker.0 00000100:00100000:2.0:1784583849.138379:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599091712:0@lo:400:kworker.0 00010000:00080000:2.0:1784583849.138388:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a34700 x1871271599092224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583849.138399:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599092224:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784583849.138505:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a35f80 x1871271599092480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583849.138519:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583849.138539:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599091072:0@lo:400:kworker.0 00000100:00100000:3.0:1784583849.138682:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092608 00000100:00100000:3.0:1784583849.138690:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092608 00000100:00100000:3.0:1784583849.138716:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784583849.138723:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599092608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583849.138735:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583849.138769:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599092608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583849.138775:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1784583849.138791:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a4fb80 x1871271599092608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583849.138804:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599092608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583849.656694:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583849.656717:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599092736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583849.656783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583849.656966:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092736 00000100:00100000:0.0:1784583849.656973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092736 00000100:00100000:0.0:1784583849.657034:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784583849.657044:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599092736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583849.657078:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583849.657138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599092736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583849.657146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784583849.657188:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599092736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583850.157693:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583851.181816:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583852.226369:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583852.640591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583852.640637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583852.640706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583852.640736:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149504 00000100:00100000:0.0:1784583852.640744:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149504 00000100:00100000:3.0:1784583852.640784:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149376 00000100:00100000:3.0:1784583852.640788:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149376 00000100:00100000:0.0:1784583852.640808:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149632 00000100:00100000:0.0:1784583852.640811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149632 00000100:00100000:3.0:1784583852.640827:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 283 00000100:00100000:0.0:1784583852.640830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:3.0:1784583852.640836:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580149376:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583852.640836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580149504:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:1.0:1784583852.640934:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583852.640938:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583852.640950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:1.0:1784583852.640959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580149632:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583852.641026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580149504:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 189us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583852.641033:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:3.0:1784583852.647906:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580149376:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 7058us (7313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583852.647921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 283 00000100:00100000:1.0:1784583852.647927:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580149632:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 6969us (7219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583852.647936:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:3.0:1784583852.718691:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583852.718715:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599092864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583852.718780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583852.719073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092864 00000100:00100000:0.0:1784583852.719080:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092864 00000100:00100000:0.0:1784583852.719212:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784583852.719222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599092864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583852.719255:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583852.719433:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599092864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583852.719440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784583852.719566:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599092864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784583853.229559:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583854.253708:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583854.253730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784583854.253866:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583854.254043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254396:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599093248:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254457:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599093760:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254510:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599094272:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254543:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784583854.254548:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599093376:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254599:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599093888:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254634:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599094400:0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.254655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.254683:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093376 00000100:00100000:1.0:1784583854.254689:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093376 00000100:00100000:1.0:1784583854.254730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784583854.254738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599093376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.255040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599093376:12345-0@lo:400:kworker.0 Request processed in 302us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.255054:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784583854.255075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093248 00000100:00100000:1.0:1784583854.255079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093248 00000100:00100000:1.0:1784583854.255400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093760 00000100:00100000:1.0:1784583854.255404:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093760 00000100:00100000:1.0:1784583854.255426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094272 00000100:00100000:1.0:1784583854.255429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094272 00000100:00100000:1.0:1784583854.255440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093888 00000100:00100000:1.0:1784583854.255442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093888 00000100:00100000:1.0:1784583854.255456:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784583854.255462:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.255513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599093248:12345-0@lo:400:kworker.0 Request processed in 51us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.255519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784583854.255531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784583854.255537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.255945:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599093504:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.255976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.255992:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599094016:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.256014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256039:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599094528:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.256059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256080:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1784583854.256094:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599093120:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.256121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256142:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599093632:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.256164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256180:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599094144:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.256199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256208:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599094656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583854.256225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583854.256250:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599092992 00000100:00100000:2.0:1784583854.256254:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599092992 00000100:00100000:2.0:1784583854.256279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094656 00000100:00100000:2.0:1784583854.256283:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094656 00000100:00100000:1.0:1784583854.256654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599093760:12345-0@lo:400:kworker.0 Request processed in 1116us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.256661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784583854.256674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093504 00000100:00100000:1.0:1784583854.256677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093504 00000100:00100000:1.0:1784583854.256689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094144 00000100:00100000:1.0:1784583854.256692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094144 00000100:00100000:1.0:1784583854.256705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784583854.256711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599094272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.256745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599094272:12345-0@lo:400:kworker.0 Request processed in 34us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.256752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784583854.256953:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784583854.256963:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583854.256984:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583854.257017:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599092992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583854.257024:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784583854.257066:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599094912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583854.257092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583854.257111:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583854.257118:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599094784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583854.257149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583854.257172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784583854.257180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.257208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599093888:12345-0@lo:400:kworker.0 Request processed in 30us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583854.257223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784583854.257253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784583854.257260:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583854.257305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599093504:12345-0@lo:400:kworker.0 Request processed in 46us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.257311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583854.257360:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094912 00000100:00100000:2.0:1784583854.257364:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094912 00000100:00100000:2.0:1784583854.257376:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094784 00000100:00100000:2.0:1784583854.257378:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094784 00000100:00100000:2.0:1784583854.257389:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583854.257395:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599094656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583854.257409:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583854.257438:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599094656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583854.257444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583854.257456:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784583854.257462:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599094912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583854.257485:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583854.257514:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599094912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583854.257528:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784583854.257540:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784583854.257547:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599094784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583854.257556:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583854.257590:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599094784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583854.257597:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1784583854.257630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a36300 x1871271599092992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583854.257650:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599092992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583854.264527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784583854.264553:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599094144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.264652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599094144:12345-0@lo:400:kworker.0 Request processed in 111us (8450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583854.264659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784583854.264699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093632 00000100:00100000:0.0:1784583854.264706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093632 00000100:00100000:0.0:1784583854.264740:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784583854.264746:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.264783:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599093120 00000100:00100000:2.0:1784583854.264797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599093120 00000100:00100000:0.0:1784583854.264800:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599093632:12345-0@lo:400:kworker.0 Request processed in 54us (8635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583854.264806:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1784583854.264852:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcdf80 x1871271599094784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583854.264869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784583854.264873:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599094784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583854.264876:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599093120:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1784583854.264886:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a37b80 x1871271599094912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583854.264897:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599094912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583854.264907:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599093120:12345-0@lo:400:kworker.0 Request processed in 33us (8786us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583854.264913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784583854.264962:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599093120:0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.264975:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599093632:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.264980:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094400 00000100:00100000:2.0:1784583854.264984:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094400 00000100:00100000:0.0:1784583854.264985:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599094144:0@lo:400:kworker.0 00010000:00080000:0.0:1784583854.264996:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab0e00 x1871271599094656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583854.265024:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599094656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583854.265040:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094016 00000100:00100000:2.0:1784583854.265043:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094016 00000100:00100000:3.0:1784583854.265070:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599094528 00000100:00100000:3.0:1784583854.265075:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599094528 00000100:00100000:3.0:1784583854.265093:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784583854.265098:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599094400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.265192:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784583854.265199:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599094016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.265286:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599093504:0@lo:400:kworker.0 00000100:00080000:0.0:1784583854.265335:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583854.265340:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583854.265344:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583854.265346:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583854.265356:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1784583854.265363:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1784583854.265374:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599094400:12345-0@lo:400:kworker.0 Request processed in 275us (10717us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583854.265381:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784583854.265394:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784583854.265405:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599094528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583854.265450:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599094528:12345-0@lo:400:kworker.0 Request processed in 45us (9390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583854.265456:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784583854.265733:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599093376:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.265742:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599094016:12345-0@lo:400:kworker.0 Request processed in 545us (9728us total) trans 0 rc 0/0 00010000:00080000:0.0:1784583854.265746:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a4ce00 x1871271599093888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583854.265754:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599093888:0@lo:400:kworker.0 00000100:00100000:2.0:1784583854.265757:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1784583854.265763:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcd500 x1871271599094400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784583854.265829:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcce00 x1871271599094528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583854.265836:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599094400:0@lo:400:kworker.0 00000100:00100000:3.0:1784583854.265837:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599094528:0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.265849:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599093248:0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.265864:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599093760:0@lo:400:kworker.0 00010000:00080000:0.0:1784583854.265877:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcd880 x1871271599094272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583854.265889:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599094272:0@lo:400:kworker.0 00010000:00080000:2.0:1784583854.265921:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a4d500 x1871271599094016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583854.265930:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599094016:0@lo:400:kworker.0 00000100:00100000:0.0:1784583854.769507:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583854.769531:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599095040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583854.769601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583854.771424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095040 00000100:00100000:1.0:1784583854.771436:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095040 00000100:00100000:1.0:1784583854.771517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784583854.771527:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599095040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784583854.771563:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784583854.771635:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599095040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583854.771642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784583854.771763:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599095040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583855.280805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583856.302702:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583857.325689:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583857.761054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583857.761127:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583857.761161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583857.761222:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149760 00000100:00100000:0.0:1784583857.761235:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149760 00000100:00100000:0.0:1784583857.761302:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 285 00000100:00100000:0.0:1784583857.761315:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580149760:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583857.761411:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580149760:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 99us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583857.761419:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 285 00000100:00100000:0.0:1784583857.761459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580149888 00000100:00100000:0.0:1784583857.761462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580149888 00000100:00100000:0.0:1784583857.761530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150016 00000100:00100000:0.0:1784583857.761534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150016 00000100:00100000:0.0:1784583857.761559:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:0.0:1784583857.761566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580149888:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583857.761599:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580149888:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583857.761606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:0.0:1784583857.761618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1784583857.761624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580150016:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583857.761647:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580150016:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583857.761673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00080000:0.0:1784583857.761847:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583857.761852:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583857.840594:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583857.840623:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599095168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583857.840707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583857.840813:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095168 00000100:00100000:3.0:1784583857.840824:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095168 00000100:00100000:3.0:1784583857.840894:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784583857.840905:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599095168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583857.840962:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583857.841013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599095168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583857.841022:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784583857.841049:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599095168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583858.352626:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784583858.411622:0:11987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:44:16 (1784583856) === 00000100:00100000:3.0:1784583858.818866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583858.819363:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150144 00000100:00100000:2.0:1784583858.819382:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150144 00000100:00100000:2.0:1784583858.819543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 286 00000100:00100000:2.0:1784583858.819558:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+10:8740:x1871271580150144:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784583858.819594:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583858.819621:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b400/0xdab2421a42e47a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee1b4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583858.819661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b400/0xdab2421a42e47a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1b4 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583858.819676:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b400/0xdab2421a42e47a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1b4 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583858.819688:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b400, rc 0) 00000100:00100000:2.0:1784583858.819804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150144:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 250us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583858.819812:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 286 00000100:00100000:0.0:1784583858.829909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.830058:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150272 00000100:00100000:3.0:1784583858.830073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150272 00000100:00100000:3.0:1784583858.830151:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 287 00000100:00100000:3.0:1784583858.830164:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150272:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784583858.830421:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150272:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 258us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.830430:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 287 00000100:00100000:0.0:1784583858.834864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.837088:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150400 00000100:00100000:3.0:1784583858.837109:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150400 00000100:00100000:3.0:1784583858.837219:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 288 00000100:00100000:3.0:1784583858.837231:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150400:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784583858.837463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150400:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 233us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.837525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 288 00000100:00100000:0.0:1784583858.850963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583858.851266:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150528 00000100:00100000:2.0:1784583858.851280:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150528 00000100:00100000:2.0:1784583858.851412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 289 00000100:00100000:2.0:1784583858.851425:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150528:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784583858.851725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150528:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 302us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583858.851736:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 289 00000100:00100000:1.0:1784583858.897956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.902827:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150656 00000100:00100000:0.0:1784583858.902846:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150656 00000100:00100000:0.0:1784583858.902945:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 290 00000100:00100000:0.0:1784583858.902956:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150656:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784583858.903295:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150656:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 339us (5351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.903304:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 290 00000100:00100000:0.0:1784583858.906445:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583858.907839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150784 00000100:00100000:2.0:1784583858.907857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150784 00000100:00100000:2.0:1784583858.907961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 291 00000100:00100000:2.0:1784583858.907973:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150784:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784583858.909834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:8744:x1871271580150784:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 1592us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583858.909851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 291 00000100:00100000:1.0:1784583858.914855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.915236:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580150912 00000100:00100000:3.0:1784583858.915250:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580150912 00000100:00100000:3.0:1784583858.915399:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 292 00000100:00100000:3.0:1784583858.915415:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+11:8740:x1871271580150912:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784583858.915441:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583858.915465:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96a00/0xdab2421a42e47a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee1e5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583858.915539:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96a00/0xdab2421a42e47a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1e5 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583858.915552:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96a00/0xdab2421a42e47a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1e5 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583858.915563:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96a00, rc 0) 00000100:00100000:3.0:1784583858.918641:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:8740:x1871271580150912:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 3210us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.918664:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 292 00000100:00100000:1.0:1784583858.934365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.934596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151040 00000100:00100000:3.0:1784583858.934610:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151040 00000100:00100000:3.0:1784583858.934675:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 293 00000100:00100000:3.0:1784583858.934687:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:8740:x1871271580151040:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784583858.934723:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784583858.934767:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784583858.934772:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784583858.934777:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784583858.934779:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1784583858.934781:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1784583858.936690:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:8740:x1871271580151040:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 1989us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.936707:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 293 00000100:00100000:3.0:1784583858.950040:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.950187:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151168 00000100:00100000:0.0:1784583858.950199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151168 00000100:00100000:0.0:1784583858.950281:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:0.0:1784583858.950293:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:8740:x1871271580151168:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784583858.950314:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583858.950341:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee1ec expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583858.950380:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583858.950416:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583858.950429:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1dc00, rc 0) 00000100:00100000:0.0:1784583858.950546:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:8740:x1871271580151168:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 256us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.950553:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:1.0:1784583858.952255:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.953851:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151296 00000100:00100000:0.0:1784583858.953865:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151296 00000100:00100000:0.0:1784583858.954091:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 295 00000100:00100000:0.0:1784583858.954112:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:8740:x1871271580151296:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784583858.954606:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:8740:x1871271580151296:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 502us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.954617:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 295 00000100:00100000:2.0:1784583858.959518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.959713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151424 00000100:00100000:3.0:1784583858.959726:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151424 00000100:00100000:3.0:1784583858.959813:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 296 00000100:00100000:3.0:1784583858.959825:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:8740:x1871271580151424:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784583858.960166:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:8740:x1871271580151424:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 341us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.960176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 296 00000100:00100000:1.0:1784583858.968535:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.968879:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151552 00000100:00100000:0.0:1784583858.968893:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151552 00000100:00100000:0.0:1784583858.968976:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 297 00000100:00100000:0.0:1784583858.968989:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:8748:x1871271580151552:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784583858.969213:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:8748:x1871271580151552:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 225us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.969222:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 297 00000100:00100000:1.0:1784583858.979986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583858.980149:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151680 00000100:00100000:3.0:1784583858.980162:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151680 00000100:00100000:3.0:1784583858.980232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 298 00000100:00100000:3.0:1784583858.980244:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:8748:x1871271580151680:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784583858.980520:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:8748:x1871271580151680:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 277us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583858.980529:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 298 00000100:00100000:2.0:1784583858.985057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583858.985108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.985296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152448 00000100:00100000:0.0:1784583858.985308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152448 00000100:00100000:0.0:1784583858.985394:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152576 00000100:00100000:0.0:1784583858.985399:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152576 00000100:00100000:0.0:1784583858.985457:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784583858.985507:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580152448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583858.985602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580152448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 135us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.985611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784583858.985630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:0.0:1784583858.985712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580152576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583858.985742:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580152576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583858.985748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:1.0:1784583858.987776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583858.987868:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583858.989841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151808 00000100:00100000:0.0:1784583858.989865:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151808 00000100:00100000:0.0:1784583858.989967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152064 00000100:00100000:0.0:1784583858.989971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152064 00000100:00100000:2.0:1784583858.990053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784583858.990065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1871271580151808:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784583858.990120:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from cf3f194e-6606-4f93-8d46-bda82242dfa1@192.168.203.51@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1784583858.990171:0:6516:0:(genops.c:1406:class_connect()) connect: client cf3f194e-6606-4f93-8d46-bda82242dfa1, cookie 0xdab2421a42e47a1d 00000004:00100000:2.0:1784583858.990210:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784583858.990375:0:6516:0:(import.c:65:import_set_state_nolock()) ffff98b43eb04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583858.990499:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2397:x1871271580151808:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 434us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583858.990508:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784583858.990530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784583858.990535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1871271580152064:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784583858.990570:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from cf3f194e-6606-4f93-8d46-bda82242dfa1@192.168.203.51@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1784583858.990598:0:6516:0:(genops.c:1406:class_connect()) connect: client cf3f194e-6606-4f93-8d46-bda82242dfa1, cookie 0xdab2421a42e47a24 00000004:00100000:2.0:1784583858.990615:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784583858.990678:0:6516:0:(import.c:65:import_set_state_nolock()) ffff98b43eb02800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583858.990719:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2397:x1871271580152064:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 182us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583858.990727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784583859.003802:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583859.003900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583859.004221:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583859.010971:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152320 00000100:00100000:3.0:1784583859.010991:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152320 00000100:00100000:3.0:1784583859.011448:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152192 00000100:00100000:3.0:1784583859.011454:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152192 00000100:00100000:3.0:1784583859.011523:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:3.0:1784583859.011536:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580152320:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784583859.011597:0:9809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784583859.011809:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580152320:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 275us (8021us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.011818:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:3.0:1784583859.011839:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:3.0:1784583859.011847:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:0:x1871271580152192:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784583859.011867:0:9809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583859.012261:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:0:x1871271580152192:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 412us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.012269:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00080000:0.0:1784583859.012777:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583859.012785:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583859.016101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580151936 00000100:00100000:2.0:1784583859.016134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580151936 00000100:00100000:2.0:1784583859.016241:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784583859.016254:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:0:x1871271580151936:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784583859.016308:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583859.016674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:0:x1871271580151936:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 422us (12452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.016683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1784583859.020150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583859.020245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152704 00000100:00100000:3.0:1784583859.020258:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152704 00000100:00100000:3.0:1784583859.020332:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784583859.020357:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580152704:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784583859.020610:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580152704:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.020647:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:0.0:1784583859.028420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583859.028512:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583859.028544:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583859.029113:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152832 00000100:00100000:2.0:1784583859.029127:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152832 00000100:00100000:2.0:1784583859.029185:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580152960 00000100:00100000:2.0:1784583859.029188:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580152960 00000100:00100000:2.0:1784583859.029216:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784583859.029226:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580152832:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784583859.029271:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from cf3f194e-6606-4f93-8d46-bda82242dfa1@192.168.203.51@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1784583859.029313:0:8428:0:(genops.c:1406:class_connect()) connect: client cf3f194e-6606-4f93-8d46-bda82242dfa1, cookie 0xdab2421a42e47a2b 00002000:00100000:2.0:1784583859.029328:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cf3f194e-6606-4f93-8d46-bda82242dfa1/ffff98b43eb03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784583859.029352:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784583859.029497:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784583859.029535:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b43eb05000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583859.029617:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2397:x1871271580152832:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 390us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.029626:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784583859.029645:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784583859.029650:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580152960:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784583859.029668:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from cf3f194e-6606-4f93-8d46-bda82242dfa1@192.168.203.51@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1784583859.029686:0:8428:0:(genops.c:1406:class_connect()) connect: client cf3f194e-6606-4f93-8d46-bda82242dfa1, cookie 0xdab2421a42e47a32 00002000:00100000:2.0:1784583859.029691:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cf3f194e-6606-4f93-8d46-bda82242dfa1/ffff98b43eb07800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784583859.029702:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784583859.029742:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784583859.029767:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b43eb00000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583859.029791:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2397:x1871271580152960:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 138us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.029797:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784583859.031007:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153088 00000100:00100000:3.0:1784583859.031020:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153088 00000100:00100000:3.0:1784583859.031081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1784583859.031090:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580153088:12345-192.168.203.51@tcp:900:mount.lustre.0 00000100:00100000:3.0:1784583859.031181:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580153088:12345-192.168.203.51@tcp:900:mount.lustre.0 Request processed in 92us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.031189:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:0.0:1784583859.044028:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583859.045227:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153216 00000100:00100000:3.0:1784583859.045244:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153216 00000100:00100000:3.0:1784583859.045331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1784583859.045353:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580153216:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784583859.045530:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784583859.045639:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:8740:x1871271580153216:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 297us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.045647:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784583859.373817:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583859.373847:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599095296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583859.373947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784583859.374253:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583859.374488:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583859.374500:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599095424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583859.374537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583859.374780:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095296 00000100:00100000:1.0:1784583859.374805:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095296 00000100:00100000:1.0:1784583859.374868:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095424 00000100:00100000:1.0:1784583859.374879:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095424 00000100:00100000:1.0:1784583859.374898:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784583859.374908:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599095296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583859.374934:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583859.375043:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599095296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583859.375050:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784583859.375085:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784583859.375091:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599095424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583859.375102:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583859.375130:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599095424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583859.375136:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1784583859.375208:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583859.375212:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784583859.375261:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9f800 x1871271599095424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583859.375289:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599095424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583859.375526:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599095552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583859.375559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583859.375687:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583859.375695:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599095680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583859.375724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583859.375762:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095552 00000100:00100000:3.0:1784583859.375767:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095552 00000100:00100000:3.0:1784583859.375799:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095680 00000100:00100000:3.0:1784583859.375802:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095680 00000100:00100000:3.0:1784583859.375815:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784583859.375821:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599095552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583859.375837:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583859.375868:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599095552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.375884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784583859.375906:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784583859.375911:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599095680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583859.375919:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583859.375938:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599095680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.375944:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1784583859.375957:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583859.375959:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784583859.375973:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412aa00 x1871271599095680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583859.376087:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599095680:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1784583859.376102:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcc700 x1871271599095552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583859.376128:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599095552:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784583859.376233:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303a4e680 x1871271599095296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583859.376245:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599095296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583859.376436:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583859.376445:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599096064:0@lo:400:kworker.0 00000100:00100000:1.0:1784583859.376504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583859.376543:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096064 00000100:00100000:1.0:1784583859.376546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096064 00000100:00100000:1.0:1784583859.376593:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784583859.376599:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599096064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583859.376637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599096064:12345-0@lo:400:kworker.0 Request processed in 37us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583859.376643:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784583859.376687:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599096064:0@lo:400:kworker.0 00000100:00100000:1.0:1784583859.376712:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599096192:0@lo:400:kworker.0 00000100:00100000:1.0:1784583859.376742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583859.376807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096192 00000100:00100000:1.0:1784583859.376811:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096192 00000100:00100000:1.0:1784583859.376853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784583859.376858:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599096192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.376949:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599095936:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.376973:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377074:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583859.377080:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599095808:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377160:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583859.377166:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599096320:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377219:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599096448:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377271:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583859.377275:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599096576:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377320:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599096704:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377368:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583859.377373:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599096832:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583859.377420:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096320 00000100:00100000:0.0:1784583859.377423:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096320 00000100:00100000:0.0:1784583859.377446:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784583859.377451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599096320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.377502:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599096320:12345-0@lo:400:kworker.0 Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583859.377508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784583859.377828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095936 00000100:00100000:2.0:1784583859.377833:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095936 00000100:00100000:2.0:1784583859.377855:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096448 00000100:00100000:2.0:1784583859.377857:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096448 00000100:00100000:2.0:1784583859.377898:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096576 00000100:00100000:2.0:1784583859.377901:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096576 00000100:00100000:2.0:1784583859.377913:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096704 00000100:00100000:2.0:1784583859.377916:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096704 00000100:00100000:2.0:1784583859.377927:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096832 00000100:00100000:2.0:1784583859.377936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096832 00000100:00100000:2.0:1784583859.377959:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784583859.377965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599095936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583859.378277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599095936:12345-0@lo:400:kworker.0 Request processed in 311us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.378284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784583859.378297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784583859.378303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599096448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583859.378326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599096448:12345-0@lo:400:kworker.0 Request processed in 24us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.378331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784583859.378340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784583859.378345:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599096576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583859.378375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599096576:12345-0@lo:400:kworker.0 Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.378380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784583859.378389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784583859.378394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599096704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583859.378416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599096704:12345-0@lo:400:kworker.0 Request processed in 22us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.378422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784583859.378431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784583859.378435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599096832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583859.378457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599096832:12345-0@lo:400:kworker.0 Request processed in 21us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583859.378496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1784583859.378514:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583859.378518:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583859.378550:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599096704:0@lo:400:kworker.0 00010000:00080000:2.0:1784583859.378563:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8380 x1871271599096576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583859.378573:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599096576:0@lo:400:kworker.0 00000100:00100000:3.0:1784583859.378711:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599095808 00000100:00100000:3.0:1784583859.378718:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599095808 00000100:00100000:3.0:1784583859.378762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784583859.378770:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599095808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583859.378803:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599095808:12345-0@lo:400:kworker.0 Request processed in 34us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583859.378809:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784583859.379010:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599096192:12345-0@lo:400:kworker.0 Request processed in 2150us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583859.379019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784583859.380133:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599096192:0@lo:400:kworker.0 00010000:00080000:0.0:1784583859.382402:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa9500 x1871271599096832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583859.382423:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599096832:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.382439:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599096448:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.382452:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599096320:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.382463:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599095808:0@lo:400:kworker.0 00000100:00100000:0.0:1784583859.382489:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599095936:0@lo:400:kworker.0 00000100:00100000:3.0:1784583859.885675:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583859.885698:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599096960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784583859.885775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583859.885892:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599096960 00000100:00100000:1.0:1784583859.885899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599096960 00000100:00100000:1.0:1784583859.885939:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784583859.885946:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599096960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784583859.885977:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784583859.886022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599096960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583859.886029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784583859.886095:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599096960:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583860.398131:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583861.423732:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583862.445981:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583862.958452:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784583862.958498:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599097088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583862.958569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583862.958639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097088 00000100:00100000:2.0:1784583862.958645:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097088 00000100:00100000:2.0:1784583862.958688:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784583862.958697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599097088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583862.958738:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583862.958783:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599097088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583862.958800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784583862.958840:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599097088:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583863.471046:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784583863.507790:0:12180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1784583864.405564:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405636:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405665:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405686:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405730:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405754:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583864.405784:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153984 00000100:00100000:2.0:1784583864.405792:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153984 00000100:00100000:2.0:1784583864.405852:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154112 00000100:00100000:2.0:1784583864.405856:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154112 00000100:00100000:2.0:1784583864.405883:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:2.0:1784583864.405891:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153984:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583864.406088:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153984:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583864.406098:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:2.0:1784583864.406114:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784583864.406121:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580154112:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583864.406148:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580154112:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583864.406154:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00080000:2.0:1784583864.406174:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583864.406178:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583864.406578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153472 00000100:00100000:3.0:1784583864.406584:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153472 00000100:00100000:3.0:1784583864.406621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153728 00000100:00100000:3.0:1784583864.406624:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153728 00000100:00100000:3.0:1784583864.406635:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153600 00000100:00100000:3.0:1784583864.406638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153600 00000100:00100000:3.0:1784583864.406650:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153856 00000100:00100000:3.0:1784583864.406652:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153856 00000100:00100000:3.0:1784583864.406665:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1784583864.406672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580153472:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583864.406729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580153472:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 47us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.406737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1784583864.406751:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:3.0:1784583864.406757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153728:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583864.406780:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153728:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.406788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:3.0:1784583864.406802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:3.0:1784583864.406809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580153600:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583864.406835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:1.0:1784583864.406847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153856:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583864.406850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580153600:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.406859:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:1.0:1784583864.406889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580153856:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 45us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583864.406897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:1.0:1784583864.406985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580153344 00000100:00100000:1.0:1784583864.406989:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580153344 00000100:00080000:2.0:1784583864.407572:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583864.407578:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583864.407585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 300 00000100:00100000:1.0:1784583864.407594:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580153344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583864.407628:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580153344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583864.407644:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 300 00010000:00010000:0.0:1784583864.495019:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583864.495152:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599097216:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495273:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599097728:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599098240:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495343:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599098752:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495379:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784583864.495385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599097600:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495441:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599098112:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495491:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599098624:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495544:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599097344:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495563:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495575:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599097856:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495604:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599098368:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784583864.495637:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599097472:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495666:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599097984:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495689:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599098496:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583864.495735:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097216 00000100:00100000:0.0:1784583864.495742:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097216 00000100:00100000:0.0:1784583864.495783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784583864.495791:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599097216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495831:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599097216:12345-0@lo:400:kworker.0 Request processed in 41us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.495838:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784583864.495866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097728 00000100:00100000:0.0:1784583864.495869:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097728 00000100:00100000:0.0:1784583864.495881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097472 00000100:00100000:0.0:1784583864.495883:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097472 00000100:00100000:0.0:1784583864.495894:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784583864.495906:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599097728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495935:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599097728:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.495940:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784583864.495951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784583864.495955:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.495980:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599097472:12345-0@lo:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.495986:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784583864.495999:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098240 00000100:00100000:0.0:1784583864.496002:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098240 00000100:00100000:0.0:1784583864.496028:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098752 00000100:00100000:0.0:1784583864.496031:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098752 00000100:00100000:0.0:1784583864.496041:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098112 00000100:00100000:0.0:1784583864.496042:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098112 00000100:00100000:0.0:1784583864.496052:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098624 00000100:00100000:0.0:1784583864.496054:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098624 00000100:00100000:0.0:1784583864.496064:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784583864.496069:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599098240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496093:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599098240:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496099:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784583864.496107:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784583864.496112:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599098752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496130:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599098752:12345-0@lo:400:kworker.0 Request processed in 19us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496136:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784583864.496150:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784583864.496155:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496176:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599098112:12345-0@lo:400:kworker.0 Request processed in 21us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496182:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784583864.496190:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784583864.496194:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496215:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599098624:12345-0@lo:400:kworker.0 Request processed in 21us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496221:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784583864.496240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097600 00000100:00100000:0.0:1784583864.496243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097600 00000100:00100000:0.0:1784583864.496257:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097344 00000100:00100000:0.0:1784583864.496259:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097344 00000100:00100000:0.0:1784583864.496266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097856 00000100:00100000:0.0:1784583864.496268:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097856 00000100:00100000:0.0:1784583864.496277:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098368 00000100:00100000:0.0:1784583864.496279:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098368 00000100:00100000:0.0:1784583864.496288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599097984 00000100:00100000:0.0:1784583864.496289:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599097984 00000100:00100000:0.0:1784583864.496298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098496 00000100:00100000:0.0:1784583864.496300:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098496 00000100:00100000:0.0:1784583864.496310:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784583864.496315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599097600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496340:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599097600:12345-0@lo:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784583864.496354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784583864.496359:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496386:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599097344:12345-0@lo:400:kworker.0 Request processed in 27us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784583864.496401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784583864.496406:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599097856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599097856:12345-0@lo:400:kworker.0 Request processed in 18us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784583864.496437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784583864.496441:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599098368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599098368:12345-0@lo:400:kworker.0 Request processed in 17us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784583864.496508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784583864.496514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599097984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496536:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599097984:12345-0@lo:400:kworker.0 Request processed in 23us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784583864.496549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784583864.496554:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496573:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599098496:12345-0@lo:400:kworker.0 Request processed in 19us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583864.496578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784583864.496625:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599097472:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.496647:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef1a300 x1871271599097984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.496657:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599097984:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.496666:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eadfb80 x1871271599098496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.496674:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599098496:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496684:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599097344:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496691:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599097856:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.496699:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599098368:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.498492:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599097600:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.498513:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef1b800 x1871271599098112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.498522:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599098112:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.498534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eaddf80 x1871271599098624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.498541:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599098624:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.498550:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599097216:0@lo:400:kworker.0 00000100:00100000:0.0:1784583864.498560:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599097728:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.498570:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef18700 x1871271599098240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.498595:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599098240:0@lo:400:kworker.0 00010000:00080000:0.0:1784583864.498608:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eaddc00 x1871271599098752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583864.498615:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599098752:0@lo:400:kworker.0 00000100:00100000:3.0:1784583864.500835:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583864.500900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583864.500933:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583864.500938:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583864.500959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583864.500990:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099136 00000100:00100000:3.0:1784583864.500995:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099136 00000100:00100000:3.0:1784583864.501033:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099264 00000100:00100000:3.0:1784583864.501035:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099264 00000100:00100000:3.0:1784583864.501047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784583864.501054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583864.501151:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583864.501204:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.501212:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784583864.501320:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599099008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583864.501349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583864.501363:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583864.501368:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599098880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583864.501388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583864.501431:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099008 00000100:00100000:3.0:1784583864.501435:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099008 00000100:00100000:3.0:1784583864.501449:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599098880 00000100:00100000:3.0:1784583864.501451:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599098880 00000100:00100000:3.0:1784583864.501462:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583864.501501:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583864.501517:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583864.501545:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.501551:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784583864.501562:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784583864.501568:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599099008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583864.501576:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583864.501606:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599099008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.501612:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784583864.501623:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784583864.501629:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599098880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583864.501637:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583864.501659:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599098880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583864.501664:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1784583864.501702:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cc380 x1871271599099264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583864.501742:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099264:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784583864.501757:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cf100 x1871271599099136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583864.501768:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099136:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1784583864.502163:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cf480 x1871271599098880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583864.502176:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599098880:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1784583864.502186:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cd880 x1871271599099008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583864.502195:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599099008:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784583864.503360:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583864.503368:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583864.503373:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583864.503375:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583865.007360:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583865.007383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599099392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583865.007450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583865.007869:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099392 00000100:00100000:2.0:1784583865.007877:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099392 00000100:00100000:2.0:1784583865.007940:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784583865.007949:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599099392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583865.008169:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583865.008230:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599099392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 282us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583865.008238:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784583865.008552:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599099392:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1784583865.010011:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00100000:0.0:1784583865.010351:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00100000:1.0:1784583865.013021:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00100000:2.0:1784583865.015583:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00010000:00010000:3.0:1784583865.528151:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583866.541902:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583867.568430:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583868.083028:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583868.083065:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599099520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583868.083131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583868.083202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099520 00000100:00100000:0.0:1784583868.083209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099520 00000100:00100000:0.0:1784583868.083251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784583868.083259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599099520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583868.084832:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583868.084930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599099520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1669us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583868.084942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784583868.085053:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599099520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583868.618307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583869.524280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583869.524312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583869.524338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583869.524358:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583869.524378:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154368 00000100:00100000:3.0:1784583869.524383:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583869.524389:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154368 00000100:00100000:3.0:1784583869.524400:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583869.524421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583869.524455:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154240 00000100:00100000:1.0:1784583869.524455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154624 00000100:00100000:1.0:1784583869.524460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154624 00000100:00100000:3.0:1784583869.524462:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154240 00000100:00100000:3.0:1784583869.524515:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:3.0:1784583869.524524:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2398:x1871271580154240:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583869.524584:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2398:x1871271580154240:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583869.524592:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:3.0:1784583869.524622:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154496 00000100:00100000:3.0:1784583869.524626:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154496 00000100:00100000:3.0:1784583869.524643:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154752 00000100:00100000:3.0:1784583869.524645:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154752 00000100:00100000:3.0:1784583869.524663:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:3.0:1784583869.524674:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580154368:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583869.524705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:1.0:1784583869.524721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580154496:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583869.524728:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580154368:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 57us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583869.524736:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:3.0:1784583869.524753:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:1.0:1784583869.524760:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580154496:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583869.524764:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154752:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583869.524774:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:1.0:1784583869.524795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:3.0:1784583869.524796:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154752:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.524803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583869.524806:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:1.0:1784583869.524849:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.524856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00080000:1.0:1784583869.524879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583869.524883:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583869.525445:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580154880 00000100:00100000:0.0:1784583869.525451:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580154880 00000100:00100000:0.0:1784583869.525509:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155008 00000100:00100000:0.0:1784583869.525512:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155008 00000100:00100000:0.0:1784583869.525532:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:0.0:1784583869.525539:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154880:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583869.525575:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580154880:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.525590:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:0.0:1784583869.525603:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784583869.525609:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580155008:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583869.525633:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580155008:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.525639:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00080000:1.0:1784583869.526929:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583869.526935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583869.614246:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583869.614314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583869.614368:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583869.614375:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599099776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583869.614402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583869.614666:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099648 00000100:00100000:1.0:1784583869.614673:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099648 00000100:00100000:1.0:1784583869.614731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099776 00000100:00100000:1.0:1784583869.614735:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099776 00000100:00100000:1.0:1784583869.614756:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784583869.614766:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583869.614776:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599099904:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583869.614793:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583869.614815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583869.614852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599099648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.614868:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784583869.614883:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599099904 00000100:00100000:1.0:1784583869.614886:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599099904 00000100:00100000:1.0:1784583869.614902:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784583869.614907:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599099776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583869.614922:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583869.614948:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599099776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.614955:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784583869.614966:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784583869.614971:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599099904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583869.614979:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583869.615013:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599099904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.615019:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1784583869.615092:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bcce00 x1871271599099904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583869.615111:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599099904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583869.615982:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3039f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599100032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583869.616019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.617059:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599100416:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.617115:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599100928:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.617158:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784583869.617164:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599100544:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.617203:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599101056:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.617248:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100416 00000100:00100000:0.0:1784583869.617254:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100416 00000100:00100000:0.0:1784583869.617293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784583869.617302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599100416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599100416:12345-0@lo:400:kworker.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.617355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784583869.617383:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100928 00000100:00100000:0.0:1784583869.617387:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100928 00000100:00100000:0.0:1784583869.617412:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100544 00000100:00100000:0.0:1784583869.617416:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100544 00000100:00100000:0.0:1784583869.617426:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101056 00000100:00100000:0.0:1784583869.617428:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101056 00000100:00100000:0.0:1784583869.617457:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784583869.617463:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599100928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617513:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599100928:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.617520:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784583869.617532:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784583869.617538:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599100544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617562:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599100544:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.617567:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784583869.617578:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784583869.617584:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599101056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617606:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599101056:12345-0@lo:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.617611:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784583869.617656:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599100544:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617665:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599101056:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.617672:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599100416:0@lo:400:kworker.0 00010000:00080000:0.0:1784583869.617682:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9c000 x1871271599100928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583869.617717:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599100928:0@lo:400:kworker.0 00000100:00080000:0.0:1784583869.620906:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583869.620916:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583869.620919:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583869.620921:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583869.620959:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599100160:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.621065:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599100672:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.621112:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599101184:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784583869.621171:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4049b8e00 x1871271599099776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583869.621191:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599099776:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784583869.621204:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427b80 x1871271599099648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583869.621216:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599099648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583869.621239:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784583869.621244:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599100288:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.621283:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599100800:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583869.621327:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100160 00000100:00100000:0.0:1784583869.621341:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100160 00000100:00100000:0.0:1784583869.621385:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784583869.621393:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599100160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621456:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599100160:12345-0@lo:400:kworker.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.621464:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784583869.621516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101184 00000100:00100000:0.0:1784583869.621520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101184 00000100:00100000:0.0:1784583869.621547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100288 00000100:00100000:0.0:1784583869.621550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100288 00000100:00100000:0.0:1784583869.621560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100800 00000100:00100000:0.0:1784583869.621562:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100800 00000100:00100000:0.0:1784583869.621576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784583869.621582:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599101184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621614:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599101184:12345-0@lo:400:kworker.0 Request processed in 32us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.621620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784583869.621632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784583869.621638:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599100288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599100288:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.621670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784583869.621680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784583869.621685:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599100800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621723:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599100800:12345-0@lo:400:kworker.0 Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.621728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1784583869.621753:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583869.621755:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583869.621763:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100672 00000100:00100000:0.0:1784583869.621766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100672 00000100:00100000:0.0:1784583869.621787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784583869.621792:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41721bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599100672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.621824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41721bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599100672:12345-0@lo:400:kworker.0 Request processed in 31us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583869.621830:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784583869.622082:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599100288:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.622092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599100800:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.622100:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599100160:0@lo:400:kworker.0 00000100:00100000:0.0:1784583869.622107:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599100672:0@lo:400:kworker.0 00010000:00080000:0.0:1784583869.622117:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ea9dc00 x1871271599101184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583869.622125:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599101184:0@lo:400:kworker.0 00010000:00010000:2.0:1784583869.622766:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583869.623145:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599100032 00000100:00100000:1.0:1784583869.623153:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599100032 00000100:00100000:1.0:1784583869.623221:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784583869.623231:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599100032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784583869.623249:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583869.623310:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599100032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (7290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583869.623317:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1784583869.623352:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3039f5c00 x1871271599100032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583869.623371:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3039f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599100032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784583869.623657:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583870.134520:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599101312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583870.134622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583870.134701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101312 00000100:00100000:3.0:1784583870.134709:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101312 00000100:00100000:3.0:1784583870.134765:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784583870.134774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599101312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583870.134810:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784583870.134865:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599101312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583870.134872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784583870.134985:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599101312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583870.647838:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583871.566092:0:12496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583871.566344:0:12496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784583871.662932:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583872.688141:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583873.199311:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583873.199336:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599101440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583873.199407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583873.199814:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101440 00000100:00100000:3.0:1784583873.199822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101440 00000100:00100000:3.0:1784583873.199873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784583873.199882:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599101440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583873.199915:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583873.199974:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599101440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583873.199981:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784583873.200142:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ea9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599101440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784583873.716850:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784583873.826787:0:12593:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583873.826994:0:12593:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784583874.645055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645126:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645153:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645169:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645217:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583874.645241:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155776 00000100:00100000:3.0:1784583874.645250:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155776 00000100:00100000:3.0:1784583874.645296:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155904 00000100:00100000:3.0:1784583874.645299:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155904 00000100:00100000:3.0:1784583874.645319:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583874.645328:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155776:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583874.645397:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155776:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583874.645405:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583874.645419:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1784583874.645425:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155904:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583874.645457:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155904:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583874.645462:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:1.0:1784583874.647935:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155264 00000100:00100000:1.0:1784583874.647949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155264 00000100:00100000:1.0:1784583874.647994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155520 00000100:00100000:1.0:1784583874.647998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155520 00000100:00100000:1.0:1784583874.648011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155392 00000100:00100000:1.0:1784583874.648013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155392 00000100:00100000:1.0:1784583874.648025:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155648 00000100:00100000:1.0:1784583874.648028:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155648 00000100:00100000:1.0:1784583874.648045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:1.0:1784583874.648055:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580155264:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583874.648130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580155264:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 76us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583874.648137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:1.0:1784583874.648154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:1.0:1784583874.648160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155520:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583874.648193:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155520:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583874.648199:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:1.0:1784583874.648210:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:1.0:1784583874.648216:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580155392:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583874.648250:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580155392:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583874.648257:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:1.0:1784583874.648269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:1.0:1784583874.648274:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155648:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583874.648295:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580155648:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 21us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583874.648301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:0.0:1784583874.648601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580155136 00000100:00100000:0.0:1784583874.648606:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580155136 00000100:00100000:0.0:1784583874.648646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00100000:0.0:1784583874.648662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580155136:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583874.648692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580155136:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 39us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583874.648699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00080000:0.0:1784583874.648744:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583874.648749:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583874.648752:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583874.648754:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583874.736606:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583874.736687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583874.736762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599101696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583874.736787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583874.736825:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101568 00000100:00100000:0.0:1784583874.736832:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101568 00000100:00100000:0.0:1784583874.736883:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101696 00000100:00100000:0.0:1784583874.736886:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101696 00000100:00100000:0.0:1784583874.736905:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784583874.736913:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599101568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784583874.736943:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583874.736985:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599101568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583874.736992:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784583874.737020:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784583874.737026:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599101696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784583874.737040:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583874.737070:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599101696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583874.737076:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1784583874.737144:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784583874.737152:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583874.737156:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784583874.737327:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424a80 x1871271599101696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583874.737354:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599101696:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784583874.737381:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427480 x1871271599101568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583874.737391:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583874.745088:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583874.745110:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599101824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583874.745177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583874.745230:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101824 00000100:00100000:0.0:1784583874.745237:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101824 00000100:00100000:0.0:1784583874.745287:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784583874.745295:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599101824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583874.745317:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583874.745358:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599101824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583874.745365:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1784583874.745387:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784583874.745413:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427480 x1871271599101824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583874.745434:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599101824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583874.746772:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599101952:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.746830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.746862:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599102464:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.746888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.746907:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599102976:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.746958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.746983:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784583874.746989:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599102080:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.747038:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599102592:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.747072:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599103104:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.747136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599101952 00000100:00100000:2.0:1784583874.747142:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599101952 00000100:00100000:2.0:1784583874.747195:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1784583874.747204:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747456:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599101952:12345-0@lo:400:kworker.0 Request processed in 253us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.747463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1784583874.747671:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102464 00000100:00100000:2.0:1784583874.747676:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102464 00000100:00100000:2.0:1784583874.747701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784583874.747706:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599102464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747749:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599102464:12345-0@lo:400:kworker.0 Request processed in 43us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.747754:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784583874.747770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102976 00000100:00100000:2.0:1784583874.747772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102976 00000100:00100000:2.0:1784583874.747800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102080 00000100:00100000:2.0:1784583874.747803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102080 00000100:00100000:2.0:1784583874.747815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102592 00000100:00100000:2.0:1784583874.747823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102592 00000100:00100000:2.0:1784583874.747841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784583874.747846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599102976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747876:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599102976:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.747882:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784583874.747892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784583874.747898:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599102080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599102080:12345-0@lo:400:kworker.0 Request processed in 24us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.747928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784583874.747937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784583874.747943:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599102592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.747966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599102592:12345-0@lo:400:kworker.0 Request processed in 24us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.747972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784583874.747988:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103104 00000100:00100000:2.0:1784583874.747992:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103104 00000100:00100000:2.0:1784583874.748380:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784583874.748387:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599103104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.748421:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599103104:12345-0@lo:400:kworker.0 Request processed in 35us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.748437:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1784583874.748492:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583874.748497:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583874.748499:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583874.748518:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599102208:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.748553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.748571:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599102720:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.748588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.748601:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599103232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583874.748619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.748637:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784583874.748642:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599102336:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.748672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.748689:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599102848:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.748708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583874.748731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103232 00000100:00100000:2.0:1784583874.748735:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103232 00000100:00100000:2.0:1784583874.748764:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784583874.748770:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599103232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583874.748786:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583874.748818:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599103232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.748824:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784583874.748838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102720 00000100:00100000:2.0:1784583874.748842:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102720 00000100:00100000:2.0:1784583874.748865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102336 00000100:00100000:2.0:1784583874.748868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102336 00000100:00100000:2.0:1784583874.748878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102848 00000100:00100000:2.0:1784583874.748881:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102848 00000100:00100000:2.0:1784583874.748893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784583874.748897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599102720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.749593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784583874.749607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599102336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.749651:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599102336:12345-0@lo:400:kworker.0 Request processed in 50us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583874.749667:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784583874.749692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784583874.749699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599102848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.749742:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599102848:12345-0@lo:400:kworker.0 Request processed in 44us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583874.749748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784583874.749765:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599102208 00000100:00100000:3.0:1784583874.749769:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599102208 00000100:00100000:3.0:1784583874.749793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784583874.749798:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599102208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.749826:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599102208:12345-0@lo:400:kworker.0 Request processed in 28us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583874.749832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784583874.749874:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599102080:0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.749887:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599102592:0@lo:400:kworker.0 00010000:00080000:3.0:1784583874.749901:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304115180 x1871271599103104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583874.750289:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599103104:0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.750305:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599101952:0@lo:400:kworker.0 00000100:00100000:3.0:1784583874.750317:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599102464:0@lo:400:kworker.0 00010000:00080000:3.0:1784583874.750328:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304117b80 x1871271599102976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583874.750337:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599102976:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.750414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599102720:12345-0@lo:400:kworker.0 Request processed in 1514us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583874.751285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1784583874.751328:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583874.751333:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583874.751365:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599102336:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.751388:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599102848:0@lo:400:kworker.0 00000100:00100000:2.0:1784583874.751398:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599102208:0@lo:400:kworker.0 00010000:00080000:2.0:1784583874.751410:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304114e00 x1871271599102720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583874.751420:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599102720:0@lo:400:kworker.0 00010000:00080000:2.0:1784583874.752700:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304117480 x1871271599103232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583874.752888:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599103232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583875.246158:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583875.246180:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599103360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784583875.246256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583875.246536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103360 00000100:00100000:3.0:1784583875.246552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103360 00000100:00100000:3.0:1784583875.246598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784583875.246612:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599103360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583875.246645:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784583875.246703:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599103360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583875.246710:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784583875.246794:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599103360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583875.759028:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784583876.416818:0:12690:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583876.417045:0:12690:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784583876.781683:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583877.810194:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583878.318658:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599103488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583878.318722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583878.318797:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103488 00000100:00100000:2.0:1784583878.318803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103488 00000100:00100000:2.0:1784583878.318843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583878.318852:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599103488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583878.318890:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583878.318933:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599103488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583878.318941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583878.318984:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599103488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784583878.829771:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784583878.989880:0:12788:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784583878.990262:0:12788:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784583879.768913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.768946:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769032:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769215:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583879.769244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156160 00000100:00100000:3.0:1784583879.769252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156160 00000100:00100000:3.0:1784583879.769301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156416 00000100:00100000:3.0:1784583879.769304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156416 00000100:00100000:3.0:1784583879.769317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156288 00000100:00100000:3.0:1784583879.769319:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156288 00000100:00100000:3.0:1784583879.769330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156544 00000100:00100000:3.0:1784583879.769332:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156544 00000100:00100000:3.0:1784583879.769346:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:3.0:1784583879.769354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580156160:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583879.769425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580156160:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.769445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:3.0:1784583879.769463:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:3.0:1784583879.769492:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580156416:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583879.769520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580156416:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 50us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.769526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:3.0:1784583879.769538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 155 00000100:00100000:3.0:1784583879.769545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580156288:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583879.769567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580156288:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.769573:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 155 00000100:00100000:3.0:1784583879.769584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00100000:3.0:1784583879.769590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580156544:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583879.769611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580156544:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.769617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00080000:3.0:1784583879.769654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583879.769657:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583879.771083:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156672 00000100:00100000:0.0:1784583879.771095:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156672 00000100:00100000:1.0:1784583879.771237:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156032 00000100:00100000:1.0:1784583879.771242:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156032 00000100:00100000:1.0:1784583879.771285:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 306 00000100:00100000:1.0:1784583879.771294:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580156032:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583879.771340:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580156032:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 47us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583879.771346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 306 00000100:00100000:1.0:1784583879.773336:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156800 00000100:00100000:1.0:1784583879.773347:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156800 00000100:00100000:1.0:1784583879.773404:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:1.0:1784583879.773413:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2397:x1871271580156800:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:1.0:1784583879.773438:0:8428:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47a32 00000100:00080000:1.0:1784583879.773447:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b43eb00000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784583879.773507:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784583879.773658:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+2:2397:x1871271580156800:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 246us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583879.773666:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00080000:1.0:1784583879.773701:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583879.773706:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784583879.773889:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583879.775449:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784583879.775461:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2397:x1871271580156672:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:0.0:1784583879.775500:0:8805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47a2b 00000100:00080000:0.0:1784583879.775507:0:8805:0:(import.c:65:import_set_state_nolock()) ffff98b43eb05000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784583879.775543:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784583879.775676:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+2:2397:x1871271580156672:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 217us (6563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583879.775683:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00010000:00010000:0.0:1784583879.775706:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583879.856214:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583879.856280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856325:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599104128:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856384:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599104640:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856431:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599105152:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856491:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784583879.856498:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599104000:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856540:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599104512:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856561:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856578:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599105024:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856862:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599103744:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.856917:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599104256:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.856950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583879.858921:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104640 00000100:00100000:1.0:1784583879.858935:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104640 00000100:00100000:1.0:1784583879.858991:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105152 00000100:00100000:1.0:1784583879.858994:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105152 00000100:00100000:1.0:1784583879.859019:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784583879.859028:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599104640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583879.859100:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599104640:12345-0@lo:400:kworker.0 Request processed in 73us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583879.859107:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784583879.859123:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784583879.859129:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599105152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583879.859157:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599105152:12345-0@lo:400:kworker.0 Request processed in 28us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583879.859163:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784583879.859178:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583879.859182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583879.859479:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599104768:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.859519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859547:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105280:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.859567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859586:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1784583879.859593:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599103872:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.859705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859728:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599104384:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.859751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599104896:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.859781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859791:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583879.859811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583879.859847:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103616 00000100:00100000:2.0:1784583879.859852:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103616 00000100:00100000:2.0:1784583879.859880:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105408 00000100:00100000:2.0:1784583879.859883:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105408 00000100:00100000:2.0:1784583879.859905:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784583879.859911:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599103616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583879.859932:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583879.859964:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599103616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.859971:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784583879.859985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784583879.859991:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583879.860013:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583879.860045:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860051:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784583879.860067:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104768 00000100:00100000:2.0:1784583879.860071:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104768 00000100:00100000:2.0:1784583879.860087:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105280 00000100:00100000:2.0:1784583879.860090:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105280 00000100:00100000:2.0:1784583879.860106:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784583879.860112:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599104768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860141:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599104768:12345-0@lo:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860148:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784583879.860158:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784583879.860164:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860188:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105280:12345-0@lo:400:kworker.0 Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860194:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784583879.860212:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104000 00000100:00100000:2.0:1784583879.860216:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104000 00000100:00100000:2.0:1784583879.860231:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104256 00000100:00100000:2.0:1784583879.860234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104256 00000100:00100000:2.0:1784583879.860246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583879.860252:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599104000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860283:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599104000:12345-0@lo:400:kworker.0 Request processed in 30us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583879.860308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784583879.860314:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599104256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860343:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599104256:12345-0@lo:400:kworker.0 Request processed in 29us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860348:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784583879.860380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104128 00000100:00100000:2.0:1784583879.860384:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104128 00000100:00100000:2.0:1784583879.860401:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104512 00000100:00100000:2.0:1784583879.860403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104512 00000100:00100000:2.0:1784583879.860415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105024 00000100:00100000:2.0:1784583879.860418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105024 00000100:00100000:2.0:1784583879.860429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103872 00000100:00100000:2.0:1784583879.860431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103872 00000100:00100000:2.0:1784583879.860440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104384 00000100:00100000:2.0:1784583879.860443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104384 00000100:00100000:2.0:1784583879.860454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599104896 00000100:00100000:2.0:1784583879.860457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599104896 00000100:00100000:2.0:1784583879.860493:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784583879.860500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599104128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599104128:12345-0@lo:400:kworker.0 Request processed in 30us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784583879.860546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784583879.860551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.860576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599104512:12345-0@lo:400:kworker.0 Request processed in 25us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.860581:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784583879.860591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784583879.860596:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599105024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784583879.861453:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583879.861460:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583879.861462:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583879.861464:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784583879.862128:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583879.862160:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784583879.862173:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599103872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583879.863581:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599103744 00000100:00100000:1.0:1784583879.863592:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599103744 00000100:00100000:1.0:1784583879.863653:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1784583879.863661:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599103744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583879.870229:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599103872:12345-0@lo:400:kworker.0 Request processed in 8051us (10515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.870256:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784583879.870293:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784583879.870304:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599104384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583879.870357:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599104384:12345-0@lo:400:kworker.0 Request processed in 56us (10604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.870363:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784583879.871054:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784583879.871066:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599104896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583879.871107:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599104896:12345-0@lo:400:kworker.0 Request processed in 45us (11325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.871114:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784583879.874717:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599105664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583879.874794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583879.874850:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599104000:0@lo:400:kworker.0 00010000:00080000:3.0:1784583879.874868:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138a80 x1871271599104512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.874879:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599104512:0@lo:400:kworker.0 00010000:00080000:3.0:1784583879.874894:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304115f80 x1871271599103616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.874911:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583879.874924:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599104128:0@lo:400:kworker.0 00010000:00080000:3.0:1784583879.874934:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30413aa00 x1871271599104640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.874950:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599104640:0@lo:400:kworker.0 00010000:00080000:3.0:1784583879.874963:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138700 x1871271599105152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.874982:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599105152:0@lo:400:kworker.0 00000100:00100000:3.0:1784583879.875022:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583879.875030:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599105536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583879.875059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583879.875090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105664 00000100:00100000:3.0:1784583879.875096:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105664 00000100:00100000:3.0:1784583879.875142:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105536 00000100:00100000:3.0:1784583879.875145:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105536 00000100:00100000:3.0:1784583879.875160:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583879.875168:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43f15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599105664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583879.875190:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583879.875229:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43f15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599105664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.875236:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583879.875677:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784583879.876175:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599105536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583879.876194:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583879.876234:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599105536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 549us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583879.876241:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1784583879.876278:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302426300 x1871271599105536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.876306:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599105536:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784583879.876320:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302426680 x1871271599105664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.876330:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599105664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583879.876698:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599105024:12345-0@lo:400:kworker.0 Request processed in 16100us (20097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583879.876708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784583879.876755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599103744:12345-0@lo:400:kworker.0 Request processed in 13094us (19858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583879.876765:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784583879.876788:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599103872:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.876800:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599104384:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.876811:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599104896:0@lo:400:kworker.0 00010000:00080000:2.0:1784583879.876822:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302427480 x1871271599105408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583879.876836:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583879.876845:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599103744:0@lo:400:kworker.0 00000100:00100000:2.0:1784583879.876857:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599104256:0@lo:400:kworker.0 00010000:00080000:2.0:1784583879.876865:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304139c00 x1871271599104768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583879.876872:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599104768:0@lo:400:kworker.0 00010000:00080000:2.0:1784583879.876880:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138000 x1871271599105280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583879.876887:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105280:0@lo:400:kworker.0 00010000:00080000:3.0:1784583879.879313:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30413a300 x1871271599105024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583879.879330:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599105024:0@lo:400:kworker.0 00000100:00100000:0.0:1784583880.368883:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599105792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583880.368954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583880.369141:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105792 00000100:00100000:2.0:1784583880.369149:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105792 00000100:00100000:2.0:1784583880.369202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784583880.369211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599105792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583880.369257:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583880.369307:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599105792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583880.369315:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784583880.369752:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599105792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583880.879888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784583881.311752:0:12885:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784583881.314935:0:12885:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784583881.902855:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583882.925612:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583883.438727:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583883.438749:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583883.438818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583883.439806:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599105920 00000100:00100000:2.0:1784583883.439815:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599105920 00000100:00100000:2.0:1784583883.439861:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784583883.439870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583883.439900:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583883.439963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599105920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583883.439971:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784583883.440015:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599105920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583883.949676:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583884.905514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583884.905774:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583884.906245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583884.906280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583884.906374:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580156928 00000100:00100000:2.0:1784583884.906383:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580156928 00000100:00100000:2.0:1784583884.906443:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 308 00000100:00100000:2.0:1784583884.906453:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580156928:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583884.906548:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580156928:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.906568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 308 00000100:00100000:0.0:1784583884.907828:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157056 00000100:00100000:0.0:1784583884.907846:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157056 00000100:00100000:0.0:1784583884.907904:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157312 00000100:00100000:0.0:1784583884.907907:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157312 00000100:00100000:0.0:1784583884.907928:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:0.0:1784583884.907948:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580157056:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:2.0:1784583884.909764:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583884.909801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:2.0:1784583884.909833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580157312:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583884.909936:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580157312:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 114us (4161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.909944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:0.0:1784583884.909988:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580157056:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 2050us (4517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583884.910006:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:3.0:1784583884.910430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583884.910556:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157184 00000100:00100000:0.0:1784583884.910565:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157184 00000100:00100000:0.0:1784583884.910631:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157440 00000100:00100000:0.0:1784583884.910634:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157440 00000100:00100000:0.0:1784583884.910650:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:0.0:1784583884.910657:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580157184:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583884.910694:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580157184:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583884.910700:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:0.0:1784583884.910713:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:0.0:1784583884.910719:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580157440:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583884.910740:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580157440:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583884.910746:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00080000:3.0:1784583884.910805:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583884.973763:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599106304:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.973827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.973880:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599106816:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.973904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.973928:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599107328:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.973981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.974012:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784583884.974019:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599106432:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.974056:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599106944:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.974108:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599107456:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583884.974158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106304 00000100:00100000:2.0:1784583884.974165:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106304 00000100:00100000:2.0:1784583884.974224:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784583884.974232:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599106304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974285:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599106304:12345-0@lo:400:kworker.0 Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784583884.974316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106816 00000100:00100000:2.0:1784583884.974320:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106816 00000100:00100000:2.0:1784583884.974371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107328 00000100:00100000:2.0:1784583884.974375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107328 00000100:00100000:2.0:1784583884.974390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106432 00000100:00100000:2.0:1784583884.974392:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106432 00000100:00100000:2.0:1784583884.974414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784583884.974421:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599106816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974456:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599106816:12345-0@lo:400:kworker.0 Request processed in 35us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784583884.974498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784583884.974503:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599107328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974530:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599107328:12345-0@lo:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784583884.974543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784583884.974549:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599106432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974569:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599106432:12345-0@lo:400:kworker.0 Request processed in 21us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784583884.974602:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106944 00000100:00100000:2.0:1784583884.974606:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106944 00000100:00100000:2.0:1784583884.974626:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107456 00000100:00100000:2.0:1784583884.974629:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107456 00000100:00100000:2.0:1784583884.974642:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784583884.974648:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599106944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974675:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599106944:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974689:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784583884.974703:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784583884.974708:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599107456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974735:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599107456:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.974742:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784583884.974784:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599106432:0@lo:400:kworker.0 00010000:00080000:2.0:1784583884.974798:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304027800 x1871271599106944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583884.974808:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599106944:0@lo:400:kworker.0 00010000:00080000:2.0:1784583884.974818:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304025f80 x1871271599107456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583884.974826:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599107456:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.974834:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599106304:0@lo:400:kworker.0 00010000:00080000:2.0:1784583884.974842:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304026d80 x1871271599106816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583884.974849:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599106816:0@lo:400:kworker.0 00010000:00080000:2.0:1784583884.974858:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304024e00 x1871271599107328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583884.974866:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599107328:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976210:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599106048:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976322:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599106560:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976380:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599107072:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976428:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599107584:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976498:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784583884.976505:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599106176:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976541:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599106688:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976575:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599107200:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583884.976633:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107072 00000100:00100000:1.0:1784583884.976639:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107072 00000100:00100000:1.0:1784583884.976672:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107584 00000100:00100000:1.0:1784583884.976675:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107584 00000100:00100000:1.0:1784583884.976689:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784583884.976696:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599107072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976740:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599107072:12345-0@lo:400:kworker.0 Request processed in 43us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583884.976747:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784583884.976760:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784583884.976766:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599107584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976806:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599107584:12345-0@lo:400:kworker.0 Request processed in 41us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583884.976811:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784583884.976839:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106560 00000100:00100000:1.0:1784583884.976842:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106560 00000100:00100000:1.0:1784583884.976864:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784583884.976870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599106560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.976898:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599106560:12345-0@lo:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583884.978543:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599107712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583884.978609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583884.978649:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599107968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583884.978671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583884.978688:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583884.978693:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599107840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583884.978712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583884.978735:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107712 00000100:00100000:3.0:1784583884.978740:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107712 00000100:00100000:3.0:1784583884.978782:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107968 00000100:00100000:3.0:1784583884.978786:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107968 00000100:00100000:3.0:1784583884.978796:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107840 00000100:00100000:3.0:1784583884.978798:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107840 00000100:00100000:3.0:1784583884.978810:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784583884.978816:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599107712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583884.978842:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583884.978882:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599107712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583884.978889:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784583884.978903:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784583884.978908:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599107968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583884.978922:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583884.979261:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599107968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 351us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583884.979268:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784583884.979280:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784583884.979287:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599107840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583884.979298:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583884.979322:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599107840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583884.979328:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784583884.979426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784583884.979457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106176 00000100:00100000:1.0:1784583884.979462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106176 00000100:00100000:1.0:1784583884.979498:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106688 00000100:00100000:1.0:1784583884.979502:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106688 00000100:00100000:1.0:1784583884.979516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599107200 00000100:00100000:1.0:1784583884.979518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599107200 00000100:00100000:1.0:1784583884.979530:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784583884.979536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599106176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.979571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599106176:12345-0@lo:400:kworker.0 Request processed in 34us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583884.979576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784583884.979585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1784583884.979761:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583884.979766:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583884.979768:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583884.979771:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784583884.979800:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304139c00 x1871271599107840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583884.979832:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599107840:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784583884.979843:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138380 x1871271599107968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583884.979853:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599107968:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784583884.979884:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138000 x1871271599107712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583884.979895:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599107712:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784583884.980196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583884.980205:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583884.980213:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599108096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583884.980246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583884.980274:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108096 00000100:00100000:0.0:1784583884.980278:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108096 00000100:00100000:0.0:1784583884.980305:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784583884.980311:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599108096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583884.980323:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583884.980367:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599108096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583884.980373:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1784583884.980400:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424700 x1871271599108096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583884.980437:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599108096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583884.980488:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599106176:0@lo:400:kworker.0 00000100:00100000:0.0:1784583884.980503:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599106560:0@lo:400:kworker.0 00010000:00080000:0.0:1784583884.980513:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304025880 x1871271599107072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583884.980525:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599107072:0@lo:400:kworker.0 00010000:00080000:0.0:1784583884.980535:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304027b80 x1871271599107584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583884.980543:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599107584:0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.981046:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599106688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583884.981630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599106688:12345-0@lo:400:kworker.0 Request processed in 586us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583884.983705:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599106688:0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.983821:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599106048 00000100:00100000:2.0:1784583884.983842:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599106048 00000100:00100000:2.0:1784583884.983902:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784583884.983911:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599106048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583884.983985:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599106048:12345-0@lo:400:kworker.0 Request processed in 76us (7711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583884.983992:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784583884.984085:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784583884.984096:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599107200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583884.984132:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599107200:12345-0@lo:400:kworker.0 Request processed in 40us (7528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583884.984137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784583884.984205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784583884.986111:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599107200:0@lo:400:kworker.0 00000100:00100000:0.0:1784583884.986126:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599106048:0@lo:400:kworker.0 00000100:00100000:0.0:1784583885.496784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599108224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583885.496855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583885.496947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108224 00000100:00100000:2.0:1784583885.496955:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108224 00000100:00100000:2.0:1784583885.497005:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784583885.497015:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599108224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583885.497049:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583885.505568:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599108224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8546us (8705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583885.506525:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784583885.507816:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599108224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583885.999247:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784583885.999277:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000020:00000080:2.0:1784583885.999282:0:9507:0:(genops.c:906:class_export_put()) final put ffff98b43eb07800/cf3f194e-6606-4f93-8d46-bda82242dfa1 00000020:00000080:2.0:1784583885.999308:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb07800/cf3f194e-6606-4f93-8d46-bda82242dfa1 for lustre-OST0001 00000020:00000080:2.0:1784583885.999355:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43eb00000 for lustre-OST0001 00000001:00100000:2.0:1784583886.001909:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000020:00000080:2.0:1784583886.001919:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b43eb03000/cf3f194e-6606-4f93-8d46-bda82242dfa1 00000020:00000080:0.0:1784583886.002551:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb03000/cf3f194e-6606-4f93-8d46-bda82242dfa1 for lustre-OST0000 00000020:00000080:0.0:1784583886.007093:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43eb05000 for lustre-OST0000 00000001:02000400:2.0:1784583886.019957:0:13030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784583887.021646:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583888.047018:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583888.557734:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583888.557760:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599108352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583888.557835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583888.558014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108352 00000100:00100000:2.0:1784583888.558022:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108352 00000100:00100000:2.0:1784583888.558094:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784583888.558105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599108352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583888.558148:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583888.558209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599108352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583888.558217:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784583888.558261:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599108352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784583889.070708:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784583889.924157:0:13177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeff08d580 20000000:00000080:0.0:1784583889.924181:0:13177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b303bb4c00 uarg=0000000000000000 20000000:01000000:0.0:1784583889.924222:0:13177:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784583889.924227:0:13177:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784583889.924233:0:13177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784583889.924936:0:13178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784583889.925160:0:13177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784583889.934855:0:13177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784583889.934889:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935041:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935051:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935126:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479de expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935135:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479ec expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935141:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e479fa expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935149:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935155:0:13177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935259:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935293:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583889.935307:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108480:192.168.203.51@tcp:104: 00010000:00010000:1.0:1784583889.935681:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935690:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 23 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583889.935700:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108608:0@lo:104: 00000100:00100000:1.0:1784583889.935743:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784583889.935783:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.935792:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 23 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583889.935800:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108736:0@lo:104: 00000100:00100000:1.0:1784583889.935821:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583889.935853:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108608 00000100:00100000:1.0:1784583889.935860:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108608 00000100:00100000:1.0:1784583889.935899:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108736 00000100:00100000:0.0:1784583889.935955:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784583889.935967:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108608:12345-0@lo:104: 00010000:00010000:0.0:1784583889.935980:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936032:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784583889.936037:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108608:12345-0@lo:104: Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.936044:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1784583889.936077:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583889.936082:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936088:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583889.936092:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936100:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583889.936107:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583889.936111:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784583889.936137:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936155:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583889.936176:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936193:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e479fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936207:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.936209:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.936211:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583889.936222:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599108864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583889.936253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583889.936288:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108864 00000100:00100000:0.0:1784583889.936291:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108864 00010000:00010000:0.0:1784583889.936307:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 24 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.936327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784583889.936333:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599108864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.936342:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583889.936346:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 24 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936355:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 24 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936370:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583889.936396:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599108864:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.936408:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784583889.936445:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599108864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.936524:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936532:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 23 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.936541:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108992:0@lo:104: 00000100:00100000:0.0:1784583889.936575:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583889.936595:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599108992 00000100:00100000:0.0:1784583889.936598:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108992 00000100:00100000:0.0:1784583889.936616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784583889.936621:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108992:12345-0@lo:104: 00010000:00010000:0.0:1784583889.936628:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936658:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784583889.936663:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108992:12345-0@lo:104: Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.936669:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1784583889.936683:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583889.936687:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936694:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583889.936697:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936711:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583889.936717:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583889.936722:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784583889.936738:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936743:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583889.936758:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936765:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e479de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936776:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.936778:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.936779:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583889.936788:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599109120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583889.936812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583889.936856:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936864:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 23 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.936872:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599109248:0@lo:104: 00000100:00100000:0.0:1784583889.936901:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583889.936920:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109248 00000100:00100000:0.0:1784583889.936923:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109248 00000100:00100000:0.0:1784583889.936940:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784583889.936946:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599109248:12345-0@lo:104: 00010000:00010000:0.0:1784583889.936954:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.936987:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784583889.936992:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599109248:12345-0@lo:104: Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.936998:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1784583889.937010:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583889.937013:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937018:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583889.937021:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937028:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583889.937033:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583889.937037:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784583889.937051:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937065:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784583889.937076:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937081:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e479d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479d7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937090:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.937091:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583889.937092:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583889.937100:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599109376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583889.937123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583889.937153:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109120 00000100:00100000:0.0:1784583889.937158:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109120 00010000:00010000:0.0:1784583889.937173:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 24 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937187:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109376 00000100:00100000:0.0:1784583889.937190:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109376 00010000:00010000:0.0:1784583889.937198:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 25 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937213:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784583889.937218:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3641:x1871271599109120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.937226:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583889.937230:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 25 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937239:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 25 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937256:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583889.937283:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3641:x1871271599109120:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.937289:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784583889.937301:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784583889.937307:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599109376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.937314:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583889.937318:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 24 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937325:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 24 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937334:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583889.937357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599109376:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.937363:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784583889.937392:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599109120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583889.937417:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599109376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.937445:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.937453:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 12 pid: 6508 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937463:0:13177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599109504:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583889.937539:0:13177:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e180 going to sleep for 11 seconds 00010000:00010000:0.0:1784583889.937565:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e47a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e479fa expref: 23 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937576:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108608:0@lo:104: 00010000:00010000:0.0:1784583889.937586:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cfe00/0xdab2421a42e479e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e479de expref: 22 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937594:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108992:0@lo:104: 00010000:00010000:0.0:1784583889.937602:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ae00/0xdab2421a42e479d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e479d0 expref: 21 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.937610:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599109248:0@lo:104: 00000100:00100000:1.0:1784583889.938367:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599108736 00000100:00100000:1.0:1784583889.938411:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784583889.938417:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108736:12345-0@lo:104: 00010000:00010000:1.0:1784583889.938429:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938504:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784583889.938510:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13177:x1871271599108736:12345-0@lo:104: Request processed in 93us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583889.938517:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1784583889.938539:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583889.938544:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938551:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583889.938566:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938574:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583889.938581:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583889.938586:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784583889.938604:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938610:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583889.938625:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938632:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96400/0xdab2421a42e479ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e479f3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938657:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583889.938659:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583889.938660:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583889.938667:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583889.938678:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599109632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784583889.938709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583889.938739:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109632 00000100:00100000:1.0:1784583889.938744:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109632 00010000:00010000:1.0:1784583889.938760:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 21 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583889.938781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784583889.938788:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599109632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784583889.938796:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583889.938800:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 21 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938809:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 21 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.938821:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583889.938846:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3640:x1871271599109632:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583889.938853:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784583889.938884:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599109632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.939289:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce400/0xdab2421a42e479f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e479ec expref: 20 pid: 6506 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.939299:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108736:0@lo:104: 00000100:00100000:0.0:1784583889.943867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583889.943957:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583889.944104:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599108480:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583889.944116:0:13177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1871271599109504:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583889.944148:0:13177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583889.944822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157568 00000100:00100000:3.0:1784583889.944831:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157568 00000100:00100000:1.0:1784583889.944996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157696 00000100:00100000:1.0:1784583889.945001:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157696 00010000:00010000:1.0:1784583889.945046:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 14 pid: 6508 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583889.945092:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:1.0:1784583889.945102:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d05096-428d-430e-97a4-2faca82157e3+14:2399:x1871271580157696:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583889.945118:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583889.945124:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 14 pid: 6508 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.945134:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 14 pid: 6508 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.945150:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e479c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ad expref: 14 pid: 6508 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583889.945162:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583889.945321:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580157696:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 220us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583889.945328:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00010000:00010000:0.0:1784583889.946922:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583889.946998:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:0.0:1784583889.947008:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+12:2399:x1871271580157568:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583889.947020:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583889.947026:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947052:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947077:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e47a16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1ec expref: 12 pid: 6507 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947090:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947098:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947114:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947121:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947128:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947134:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947140:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583889.947144:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947150:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.947182:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583889.947321:0:13177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583889.947330:0:13177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.949037:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce200/0xdab2421a42e47a39 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583889.949068:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583889.949140:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+11:2399:x1871271580157568:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2129us (5278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583889.949149:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1784583890.007871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583890.007908:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583890.007930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583890.007962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583890.007991:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157952 00000100:00100000:2.0:1784583890.007999:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157952 00000100:00100000:2.0:1784583890.008048:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158208 00000100:00100000:2.0:1784583890.008051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158208 00000100:00100000:2.0:1784583890.008078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580157824 00000100:00100000:2.0:1784583890.008081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580157824 00000100:00100000:2.0:1784583890.008093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158080 00000100:00100000:2.0:1784583890.008095:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158080 00000100:00100000:2.0:1784583890.008110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:2.0:1784583890.008128:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580157952:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583890.008211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580157952:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.008219:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:2.0:1784583890.008236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:2.0:1784583890.008242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580158208:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583890.008266:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580158208:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.008271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:2.0:1784583890.008281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:2.0:1784583890.008286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580157824:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583890.008304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580157824:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 19us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.008309:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:2.0:1784583890.008318:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:2.0:1784583890.008323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580158080:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583890.008343:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580158080:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 20us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.008349:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00080000:2.0:1784583890.008370:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583890.008374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583890.093822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599110144:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.093928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.093992:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599110656:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094043:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599111168:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094104:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784583890.094109:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599109760:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094146:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599110272:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094179:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599110784:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094218:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599109888:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094253:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599110400:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094286:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599110912:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094315:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784583890.094320:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599110016:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094346:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599110528:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094378:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599111040:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.094433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110144 00000100:00100000:2.0:1784583890.094440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110144 00000100:00100000:2.0:1784583890.094499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109888 00000100:00100000:2.0:1784583890.094503:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109888 00000100:00100000:2.0:1784583890.094520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784583890.094528:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599110144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094591:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599110144:12345-0@lo:400:kworker.0 Request processed in 63us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784583890.094614:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583890.094620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599109888:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583890.094671:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110656 00000100:00100000:2.0:1784583890.094674:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110656 00000100:00100000:2.0:1784583890.094700:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111168 00000100:00100000:2.0:1784583890.094702:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111168 00000100:00100000:2.0:1784583890.094711:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110528 00000100:00100000:2.0:1784583890.094713:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110528 00000100:00100000:2.0:1784583890.094723:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111040 00000100:00100000:2.0:1784583890.094725:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111040 00000100:00100000:2.0:1784583890.094735:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784583890.094740:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599110656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094765:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599110656:12345-0@lo:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094770:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784583890.094780:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784583890.094786:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599111168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094816:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599111168:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094822:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784583890.094832:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784583890.094837:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599110528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094861:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599110528:12345-0@lo:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094866:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784583890.094876:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784583890.094881:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599111040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.094904:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599111040:12345-0@lo:400:kworker.0 Request processed in 23us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.094910:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784583890.094931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599109760 00000100:00100000:2.0:1784583890.094934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599109760 00000100:00100000:2.0:1784583890.094950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110272 00000100:00100000:2.0:1784583890.094954:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110272 00000100:00100000:2.0:1784583890.094965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110784 00000100:00100000:2.0:1784583890.094967:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110784 00000100:00100000:2.0:1784583890.094977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110400 00000100:00100000:2.0:1784583890.094979:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110400 00000100:00100000:2.0:1784583890.094989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110912 00000100:00100000:2.0:1784583890.094991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110912 00000100:00100000:2.0:1784583890.095000:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599110016 00000100:00100000:2.0:1784583890.095002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599110016 00000100:00100000:2.0:1784583890.095013:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784583890.095018:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095047:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599109760:12345-0@lo:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095060:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784583890.095072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784583890.095078:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599110272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095105:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599110272:12345-0@lo:400:kworker.0 Request processed in 28us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095111:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784583890.095122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784583890.095126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599110784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599110784:12345-0@lo:400:kworker.0 Request processed in 23us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784583890.095166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784583890.095172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599110400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095195:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599110400:12345-0@lo:400:kworker.0 Request processed in 24us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095201:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784583890.095211:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784583890.095216:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599110912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095239:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599110912:12345-0@lo:400:kworker.0 Request processed in 23us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095245:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784583890.095255:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784583890.095261:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599110016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095284:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599110016:12345-0@lo:400:kworker.0 Request processed in 23us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.095296:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1784583890.095332:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583890.095336:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583890.095338:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583890.095340:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583890.095370:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599110016:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095381:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7a1180 x1871271599110528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095391:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599110528:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095398:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30404ca80 x1871271599111040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095406:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599111040:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095415:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599109888:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095423:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7a3b80 x1871271599110400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095430:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599110400:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7a2a00 x1871271599110912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095444:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599110912:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095498:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599109760:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095506:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599110272:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095513:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599110784:0@lo:400:kworker.0 00000100:00100000:2.0:1784583890.095532:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599110144:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095540:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7a3480 x1871271599110656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095547:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599110656:0@lo:400:kworker.0 00010000:00080000:2.0:1784583890.095566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30404e300 x1871271599111168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583890.095573:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599111168:0@lo:400:kworker.0 00010000:00010000:2.0:1784583890.098315:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583890.099251:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583890.099273:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599111424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583890.099342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583890.099394:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111424 00000100:00100000:3.0:1784583890.099401:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111424 00000100:00100000:3.0:1784583890.099444:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784583890.099452:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599111424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583890.099507:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583890.099548:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599111424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583890.099585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784583890.099613:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599111296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583890.099640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583890.099673:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111296 00000100:00100000:3.0:1784583890.099677:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111296 00000100:00100000:3.0:1784583890.099699:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784583890.099705:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599111296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583890.099715:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583890.099744:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599111296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583890.099750:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1784583890.099780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304138380 x1871271599111296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583890.099798:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599111296:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784583890.099822:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304139c00 x1871271599111424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583890.099832:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599111424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583890.101003:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583890.101047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.102017:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111552 00000100:00100000:2.0:1784583890.102029:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111552 00000100:00100000:2.0:1784583890.102097:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784583890.102107:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599111552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583890.102136:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583890.102205:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599111552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.102213:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1784583890.103072:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304024000 x1871271599111552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583890.103095:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583890.103682:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599111680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583890.103741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583890.103825:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111680 00000100:00100000:2.0:1784583890.103831:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111680 00000100:00100000:2.0:1784583890.103872:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784583890.103881:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599111680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583890.103899:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583890.104275:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599111680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 394us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583890.104283:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1784583890.104489:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80ed80 x1871271599111680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583890.104506:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599111680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583890.605809:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599111808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583890.605884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583890.606050:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111808 00000100:00100000:0.0:1784583890.606067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111808 00000100:00100000:0.0:1784583890.606138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784583890.606147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599111808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583890.606189:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583890.614249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599111808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8082us (8343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583890.614265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784583890.615023:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599111808:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583891.119960:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583891.161416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583891.162236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158336 00000100:00100000:1.0:1784583891.162247:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158336 00000100:00100000:1.0:1784583891.162343:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 310 00000100:00100000:1.0:1784583891.162353:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+11:6171:x1871271580158336:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583891.162369:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583891.162399:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee21d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.162438:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.162450:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.162496:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf000, rc 0) 00000100:00100000:1.0:1784583891.162594:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158336:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 242us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583891.162601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 310 00000100:00100000:2.0:1784583891.171045:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583891.182979:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158464 00000100:00100000:0.0:1784583891.182992:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158464 00000100:00100000:0.0:1784583891.183157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 311 00000100:00100000:0.0:1784583891.183168:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158464:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.183318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158464:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 151us (12281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583891.183330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 311 00000100:00100000:3.0:1784583891.195671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583891.195756:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158592 00000100:00100000:0.0:1784583891.195783:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158592 00000100:00100000:0.0:1784583891.195838:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 312 00000100:00100000:0.0:1784583891.195848:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158592:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.195980:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158592:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 132us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583891.195988:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 312 00000100:00100000:2.0:1784583891.223237:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583891.223270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158720 00000100:00100000:2.0:1784583891.223279:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158720 00000100:00100000:2.0:1784583891.223324:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 313 00000100:00100000:2.0:1784583891.223334:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580158720:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583891.223350:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583891.223368:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee224 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583891.223394:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583891.223405:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583891.223413:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a400, rc 0) 00000100:00100000:2.0:1784583891.223463:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580158720:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583891.223484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 313 00000100:00100000:3.0:1784583891.233771:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583891.233800:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158848 00000100:00100000:3.0:1784583891.233808:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158848 00000100:00100000:3.0:1784583891.233849:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 314 00000100:00100000:3.0:1784583891.233857:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580158848:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.233979:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580158848:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.233987:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 314 00000100:00100000:3.0:1784583891.236255:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583891.236287:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580158976 00000100:00100000:3.0:1784583891.236296:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580158976 00000100:00100000:2.0:1784583891.236346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 315 00000100:00100000:2.0:1784583891.236359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580158976:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583891.236795:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580158976:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 437us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583891.236804:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 315 10000000:01000000:0.0:1784583891.693582:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784583891.693590:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b30245a800 from 7 10000000:01000000:0.0:1784583891.693596:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784583891.693645:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.693657:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.693668:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583891.693697:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599111936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.693759:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583891.693802:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4071baa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.695060:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599111936 00000100:00100000:3.0:1784583891.695073:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599111936 00000100:00100000:3.0:1784583891.695139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784583891.695150:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599111936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583891.695166:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583891.695182:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47a4e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.695206:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.695231:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.695240:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:3.0:1784583891.696300:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599111936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1150us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.696307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784583891.698112:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599111936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583891.698139:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.698152:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583891.698236:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.698304:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583891.698351:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4071baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583891.698403:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112064 00000100:00100000:2.0:1784583891.698409:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112064 00000100:00100000:2.0:1784583891.698458:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1784583891.698496:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599112064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583891.698641:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599112064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583891.698649:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784583891.698755:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.698781:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.698819:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583891.698844:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4071baa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.698889:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112192 00000100:00100000:3.0:1784583891.698894:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112192 00000100:00100000:3.0:1784583891.698923:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1784583891.698934:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599112192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.699017:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599112192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.699024:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784583891.699173:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784583891.700366:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784583891.701591:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784583891.701625:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784583891.701636:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.701648:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583891.701658:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784583891.701660:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b43e967000 from 7 10000000:01000000:1.0:1784583891.701663:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784583891.701699:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.701708:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.701719:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583891.701760:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784583891.701821:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583891.701854:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.703079:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112320 00000100:00100000:3.0:1784583891.703092:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112320 00000100:00100000:3.0:1784583891.703155:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784583891.703167:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599112320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583891.703184:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583891.703201:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47a5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.703225:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.703235:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.703252:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96000, rc 0) 00000100:00100000:3.0:1784583891.703314:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.703320:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784583891.703380:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583891.703394:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.703404:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583891.703496:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.703524:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583891.703553:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.703566:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112448 00000100:00100000:3.0:1784583891.703570:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112448 00000100:00100000:3.0:1784583891.703591:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784583891.703597:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.703692:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.703699:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784583891.703727:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.703753:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.703790:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583891.703809:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.703819:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112576 00000100:00100000:3.0:1784583891.703822:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112576 00000100:00100000:3.0:1784583891.703841:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784583891.703846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.703917:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.703922:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784583891.705273:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784583891.709334:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784583891.712661:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784583891.712704:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583891.712715:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.712726:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583891.712736:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583891.712739:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b42ba2f000 from 7 10000000:01000000:3.0:1784583891.712742:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583891.712780:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.712788:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.712799:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583891.712827:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.712900:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583891.715034:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112704 00000100:00100000:3.0:1784583891.715042:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583891.715049:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112704 00000100:00100000:0.0:1784583891.715113:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1784583891.715123:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599112704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583891.715149:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583891.715169:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47a6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.715197:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.715208:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.715217:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d000, rc 0) 00000100:00100000:0.0:1784583891.715284:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599112704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583891.715292:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784583891.715596:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583891.715611:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.715620:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583891.715690:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.715722:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583891.715749:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583891.715788:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112832 00000100:00100000:1.0:1784583891.715792:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112832 00000100:00100000:1.0:1784583891.715821:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784583891.715827:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599112832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583891.715933:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599112832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583891.715941:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1784583891.716345:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.716386:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.716422:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583891.716446:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4071ba3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.716509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599112960 00000100:00100000:3.0:1784583891.716513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599112960 00000100:00100000:3.0:1784583891.716539:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784583891.716556:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599112960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.716638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599112960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.716645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1784583891.716793:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599112960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784583891.717720:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784583891.721444:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784583891.721497:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583891.721509:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.721599:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583891.721624:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583891.721627:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b418942800 from 7 10000000:01000000:3.0:1784583891.721630:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583891.721667:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.721675:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.721686:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583891.721712:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.721782:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583891.721826:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583891.721902:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113088 00000100:00100000:0.0:1784583891.721910:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113088 00000100:00100000:0.0:1784583891.722192:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1784583891.722203:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599113088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583891.722216:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583891.722229:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47a78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.722252:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.722329:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583891.722338:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d400, rc 0) 00000100:00100000:0.0:1784583891.722458:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599113088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583891.722484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1784583891.722707:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583891.722722:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583891.722732:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583891.722793:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583891.722822:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583891.722886:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e300 going to sleep for 11 seconds 00000100:00100000:3.0:1784583891.723019:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113216 00000100:00100000:3.0:1784583891.723024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113216 00000100:00100000:3.0:1784583891.723085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784583891.723093:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599113216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583891.723196:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599113216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583891.723203:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1784583891.723267:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583891.723295:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583891.723328:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583891.723439:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e300 going to sleep for 11 seconds 00000100:00100000:0.0:1784583891.723492:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113344 00000100:00100000:0.0:1784583891.723497:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113344 00000100:00100000:0.0:1784583891.723516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1784583891.723522:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599113344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583891.723605:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599113344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583891.723612:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1784583891.723683:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599113344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784583891.725136:0:13237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784583891.725288:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784583891.725310:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583891.725321:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583891.725332:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583892.141715:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583893.168155:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583893.678816:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583893.678841:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599113472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583893.678909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583893.679013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113472 00000100:00100000:2.0:1784583893.679020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113472 00000100:00100000:2.0:1784583893.679071:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784583893.679080:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599113472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583893.679111:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583893.679156:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599113472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583893.679164:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784583893.679204:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599113472:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1784583893.869094:0:13376:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784583894.192002:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583895.136639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583895.136725:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583895.136753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583895.136776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159360 00000100:00100000:3.0:1784583895.136783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583895.136787:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159360 00000100:00100000:3.0:1784583895.136813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583895.136844:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159616 00000100:00100000:2.0:1784583895.136848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159232 00000100:00100000:3.0:1784583895.136849:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159616 00000100:00100000:2.0:1784583895.136854:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159232 00000100:00100000:2.0:1784583895.136872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159488 00000100:00100000:2.0:1784583895.136875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159488 00000100:00100000:3.0:1784583895.136903:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:2.0:1784583895.136916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:3.0:1784583895.136923:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580159360:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583895.136931:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580159232:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583895.136999:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580159360:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.137006:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:3.0:1784583895.137037:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:3.0:1784583895.137045:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580159616:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583895.137070:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580159616:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.137077:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:3.0:1784583895.137090:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00100000:3.0:1784583895.137098:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580159488:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583895.137111:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580159232:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 183us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.137131:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580159488:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583895.137141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:3.0:1784583895.137149:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00080000:2.0:1784583895.137163:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583895.137168:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583895.150260:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159104 00000100:00100000:1.0:1784583895.150275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159104 00000100:00100000:1.0:1784583895.151195:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 328 00000100:00100000:1.0:1784583895.151211:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580159104:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583895.151338:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580159104:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 132us (14708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583895.151346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 328 00000100:00100000:3.0:1784583895.213667:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599113600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583895.213785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.213854:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599113728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583895.213888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.213906:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583895.213911:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599113856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583895.213931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.213956:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113600 00000100:00100000:3.0:1784583895.213962:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113600 00000100:00100000:3.0:1784583895.214018:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113728 00000100:00100000:3.0:1784583895.214022:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113728 00000100:00100000:3.0:1784583895.214043:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113856 00000100:00100000:3.0:1784583895.214054:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113856 00000100:00100000:3.0:1784583895.214079:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784583895.214088:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599113600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583895.214116:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583895.214156:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599113600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.214163:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784583895.214178:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784583895.214184:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599113728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583895.214208:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583895.214237:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599113728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.214243:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784583895.214255:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784583895.214261:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599113856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583895.214284:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583895.214308:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599113856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.214314:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1784583895.214351:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304117b80 x1871271599113600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583895.214368:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599113600:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784583895.214395:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304115180 x1871271599113856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583895.214407:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599113856:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784583895.214416:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304117100 x1871271599113728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583895.214425:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599113728:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784583895.214440:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583895.214444:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583895.217972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599113984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583895.218287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583895.218360:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599113984 00000100:00100000:1.0:1784583895.218367:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599113984 00000100:00100000:1.0:1784583895.218423:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784583895.218432:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599113984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784583895.218454:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583895.218542:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599113984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583895.218548:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1784583895.218574:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784583895.218600:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80ea00 x1871271599113984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583895.218621:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599113984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784583895.218807:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583895.218975:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599114240:0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.219019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583895.219272:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599114112:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.219306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583895.219335:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599114624:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.219359:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583895.219376:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599115136:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.219403:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114112 00000100:00100000:0.0:1784583895.219409:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114112 00000100:00100000:0.0:1784583895.219442:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784583895.219450:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599114112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.219509:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3642:x1871271599114112:12345-0@lo:400:kworker.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583895.219516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784583895.219554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114624 00000100:00100000:0.0:1784583895.219558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114624 00000100:00100000:0.0:1784583895.219581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784583895.219587:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599114624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.220289:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599114624:12345-0@lo:400:kworker.0 Request processed in 700us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583895.220311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784583895.220425:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599114752:0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.220484:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784583895.220491:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599114368:0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.220534:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599114880:0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583895.220593:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114240 00000100:00100000:3.0:1784583895.220599:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114240 00000100:00100000:3.0:1784583895.220626:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114752 00000100:00100000:3.0:1784583895.220629:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114752 00000100:00100000:3.0:1784583895.220649:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114880 00000100:00100000:3.0:1784583895.220652:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114880 00000100:00100000:3.0:1784583895.220666:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784583895.220673:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599114240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220713:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599114240:12345-0@lo:400:kworker.0 Request processed in 41us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.220719:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784583895.220732:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784583895.220738:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599114752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220763:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599114752:12345-0@lo:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.220768:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784583895.220778:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784583895.220783:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599114880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220806:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599114880:12345-0@lo:400:kworker.0 Request processed in 23us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583895.220811:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00080000:3.0:1784583895.220845:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304128e00 x1871271599114880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583895.220857:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599114880:0@lo:400:kworker.0 00000100:00100000:3.0:1784583895.220866:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599114240:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222282:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599114496:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583895.222356:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599115008:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583895.222411:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114496 00000100:00100000:2.0:1784583895.222416:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114496 00000100:00100000:2.0:1784583895.222449:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115008 00000100:00100000:2.0:1784583895.222452:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115008 00000100:00100000:2.0:1784583895.222488:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784583895.222496:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599114496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222551:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599114496:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583895.222557:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784583895.222571:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784583895.222576:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599115008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222598:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599115008:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583895.222603:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1784583895.222618:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583895.222621:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583895.222643:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599114496:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.222651:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599115008:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.222770:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599114368 00000100:00100000:0.0:1784583895.222774:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599114368 00000100:00100000:0.0:1784583895.222809:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784583895.222814:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599114368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.222850:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599114368:12345-0@lo:400:kworker.0 Request processed in 36us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583895.222856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784583895.222873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583895.222901:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599114112:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.222912:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599114624:0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.222928:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115136 00000100:00100000:0.0:1784583895.222930:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115136 00000100:00100000:0.0:1784583895.222955:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784583895.222962:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599115136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583895.222993:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599115136:12345-0@lo:400:kworker.0 Request processed in 32us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583895.222999:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:0.0:1784583895.223023:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30412b800 x1871271599115136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583895.223034:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599115136:0@lo:400:kworker.0 00000100:00080000:0.0:1784583895.223567:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583895.225398:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599114752:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.225435:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599114368:0@lo:400:kworker.0 00000100:00100000:2.0:1784583895.725788:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599115264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784583895.725857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583895.726012:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115264 00000100:00100000:1.0:1784583895.726019:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115264 00000100:00100000:1.0:1784583895.726070:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784583895.726080:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599115264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784583895.726114:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784583895.726164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599115264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583895.726171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784583895.726255:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599115264:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583896.237776:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583897.263569:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583898.287432:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583898.798894:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583898.798917:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599115392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583898.798997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583898.800225:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115392 00000100:00100000:1.0:1784583898.800235:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115392 00000100:00100000:1.0:1784583898.800283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784583898.800292:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599115392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583898.800328:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583898.800387:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599115392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583898.800394:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784583898.800438:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599115392:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784583899.018949:0:13526:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:44:57 (1784583897) === 00000100:00100000:3.0:1784583899.244739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583899.244785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.244874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159744 00000100:00100000:2.0:1784583899.244883:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159744 00000100:00100000:2.0:1784583899.244975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1784583899.244986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580159744:12345-192.168.203.51@tcp:41:mkdir.0 00000100:00100000:0.0:1784583899.245004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580159872 00000100:00100000:0.0:1784583899.245008:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580159872 00000004:00000024:2.0:1784583899.245024:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583899.245047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1784583899.245052:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10511:x1871271580159872:12345-192.168.203.51@tcp:700:mkdir.0 00000100:00100000:2.0:1784583899.245097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2399:x1871271580159744:12345-192.168.203.51@tcp:41:mkdir.0 Request processed in 113us (367us total) trans 0 rc 0/0 00000100:00080000:1.0:1784583899.245100:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583899.245105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:0.0:1784583899.246459:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:10511:x1871271580159872:12345-192.168.203.51@tcp:700:mkdir.0 Request processed in 1327us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583899.246503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784583899.253276:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.253342:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160128 00000100:00100000:0.0:1784583899.253352:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160128 00000100:00100000:0.0:1784583899.253568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784583899.253580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:10511:x1871271580160128:12345-192.168.203.51@tcp:36:mkdir.0 00010000:00010000:0.0:1784583899.253650:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583899.253703:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee198 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253724:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1b00) 00010000:00010000:0.0:1784583899.253747:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583899.253828:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253841:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253851:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253876:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253884:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.253911:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256717:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256739:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256750:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583899.256768:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b38b2c55 reply state 0000000075bd084f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256779:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256787:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:0.0:1784583899.256789:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583899.256793:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784583899.256799:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784583899.256807:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256813:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256819:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256825:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ca00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.256840:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256848:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256858:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7d00) 00010000:00010000:0.0:1784583899.256860:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583899.256864:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256871:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47a86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583899.256886:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b38b2c55 reply state 0000000075bd084f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256894:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.256901:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b3037b7e00) 00010000:00010000:0.0:1784583899.256903:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583899.256905:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784583899.257665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10511:x1871271580160128:12345-192.168.203.51@tcp:36:mkdir.0 Request processed in 4079us (4390us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784583899.257675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1784583899.265552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.266030:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160256 00000100:00100000:2.0:1784583899.266039:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160256 00000100:00100000:2.0:1784583899.266100:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1784583899.266111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10512:x1871271580160256:12345-192.168.203.51@tcp:101:chmod.0 00010000:00010000:2.0:1784583899.266132:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583899.266156:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee22b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266215:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266244:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266257:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583899.266305:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784583899.266309:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583899.266339:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266363:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee22b expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266379:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee22b expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.266387:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769d00) 00010000:00010000:2.0:1784583899.266390:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583899.266393:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784583899.266454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:10512:x1871271580160256:12345-192.168.203.51@tcp:101:chmod.0 Request processed in 345us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.266461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784583899.277600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.277706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160512 00000100:00100000:2.0:1784583899.277715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160512 00000100:00100000:2.0:1784583899.277776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:2.0:1784583899.277786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:10512:x1871271580160512:12345-192.168.203.51@tcp:36:chmod.0 00010000:00010000:2.0:1784583899.277834:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583899.277880:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47aa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee22b expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.277898:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769d00) 00010000:00010000:2.0:1784583899.277907:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583899.277932:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.277944:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.277954:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583899.278148:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089d14851 reply state 00000000e4b72d5a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.278172:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.278179:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:2.0:1784583899.278181:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784583899.278183:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784583899.278190:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784583899.278264:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:10512:x1871271580160512:12345-192.168.203.51@tcp:36:chmod.0 Request processed in 478us (671us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784583899.278271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1784583899.305792:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.305904:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160640 00000100:00100000:0.0:1784583899.305913:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160640 00000100:00100000:0.0:1784583899.305984:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:0.0:1784583899.305995:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:10513:x1871271580160640:12345-192.168.203.51@tcp:101:chown.0 00010000:00010000:0.0:1784583899.306021:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583899.306052:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee232 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306112:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306126:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306137:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583899.306340:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784583899.306344:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583899.306377:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306411:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee232 expref: 11 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306431:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee232 expref: 10 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.306440:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:0.0:1784583899.306443:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583899.306447:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1ce00, rc 0) 00000100:00100000:0.0:1784583899.306697:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:10513:x1871271580160640:12345-192.168.203.51@tcp:101:chown.0 Request processed in 703us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583899.306705:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00010000:00010000:0.0:1784583899.309554:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583899.310514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.310677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160768 00000100:00100000:2.0:1784583899.310686:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160768 00000100:00100000:2.0:1784583899.310735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:2.0:1784583899.310743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:10513:x1871271580160768:12345-192.168.203.51@tcp:101:chown.0 00010000:00010000:2.0:1784583899.310769:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583899.310786:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee239 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310838:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310862:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310873:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310883:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310890:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.310896:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311268:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311278:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311286:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583899.311327:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784583899.311336:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583899.311357:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311370:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311376:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311383:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311400:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.311404:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311412:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311424:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:2.0:1784583899.311427:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.311431:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311437:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311450:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311456:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311637:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311643:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.311645:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311652:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311661:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b3037b7e00) 00010000:00010000:2.0:1784583899.311664:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.311667:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311672:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47acc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311699:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee239 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311713:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee239 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.311720:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:2.0:1784583899.311721:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583899.311723:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784583899.311779:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10513:x1871271580160768:12345-192.168.203.51@tcp:101:chown.0 Request processed in 1035us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.311798:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1784583899.322322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.322511:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580160896 00000100:00100000:0.0:1784583899.322520:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580160896 00000100:00100000:0.0:1784583899.322575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:0.0:1784583899.322584:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10513:x1871271580160896:12345-192.168.203.51@tcp:900:chown.0 00000100:00100000:0.0:1784583899.322661:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10513:x1871271580160896:12345-192.168.203.51@tcp:900:chown.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583899.322669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1784583899.325074:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.328649:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580161152 00000100:00100000:2.0:1784583899.328665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580161152 00000100:00100000:2.0:1784583899.328779:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1784583899.328790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10513:x1871271580161152:12345-192.168.203.51@tcp:36:chown.0 00010000:00010000:2.0:1784583899.328852:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583899.328878:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ad3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee239 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.328895:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:2.0:1784583899.328900:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583899.328922:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.328936:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.328946:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583899.336252:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1784583899.337107:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000512b272c reply state 000000006f470fed transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.337132:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.337142:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:2.0:1784583899.337146:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784583899.337150:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784583899.337185:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1784583899.337270:0:6514:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784583899.337288:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:10513:x1871271580161152:12345-192.168.203.51@tcp:36:chown.0 Request processed in 8496us (12219us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784583899.337297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00010000:00010000:0.0:1784583899.337552:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337562:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337569:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337576:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.337580:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337589:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337601:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:0.0:1784583899.337604:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784583899.337608:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.337614:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ada lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341272:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341289:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341298:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341304:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1dc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583899.341308:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341315:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341334:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b3037b7e00) 00010000:00010000:3.0:1784583899.341337:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583899.341352:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341359:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47a8d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341380:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341397:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341403:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341408:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583899.341412:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341419:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341427:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b3037b7a00) 00010000:00010000:3.0:1784583899.341429:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583899.341432:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341437:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47a94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341452:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341458:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341490:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341504:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ac00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583899.341507:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341513:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341521:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:3.0:1784583899.341524:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784583899.341527:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.341531:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47aa9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583899.362805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.362904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580161280 00000100:00100000:0.0:1784583899.362914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580161280 00000100:00100000:0.0:1784583899.362989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1784583899.362999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:10514:x1871271580161280:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:0.0:1784583899.363024:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583899.363043:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee240 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784583899.364586:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1495us 00010000:00010000:2.0:1784583899.440297:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440321:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440333:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440348:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440355:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440362:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440520:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440529:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440536:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583899.440568:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784583899.440576:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583899.440618:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440631:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440638:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440645:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440651:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.440655:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440661:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440674:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:2.0:1784583899.440676:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.440680:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440686:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440697:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440703:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440719:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440723:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.440726:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440732:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440739:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b408769d00) 00010000:00010000:2.0:1784583899.440742:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.440744:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440749:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47aef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440786:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee240 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440801:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee240 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.440809:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:2.0:1784583899.440811:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784583899.440813:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784583899.440894:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10514:x1871271580161280:12345-192.168.203.51@tcp:101:touch.500 Request processed in 77895us (78097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.440911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1784583899.444722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583899.445079:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580161536 00000100:00100000:3.0:1784583899.445091:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580161536 00000100:00100000:3.0:1784583899.445257:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:3.0:1784583899.445270:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10514:x1871271580161536:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:3.0:1784583899.445293:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583899.445313:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47afd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee247 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445451:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445505:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445530:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445589:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445597:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.445604:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784583899.446029:0:9809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1784583899.446188:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47b12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446198:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47b12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446205:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47b12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446235:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446242:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446249:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446255:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583899.446265:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446272:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446284:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:3.0:1784583899.446286:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583899.446291:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446297:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97e00/0xdab2421a42e47b04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583899.446309:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000786bf316 reply state 000000002e7a9e4f transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446319:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446325:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff98b43e8ab800) 00010000:00010000:3.0:1784583899.446327:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583899.446329:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784583899.446356:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47afd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee247 expref: 10 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446368:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47b12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee247 expref: 9 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.446376:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b43e8ab900) 00010000:00010000:3.0:1784583899.446377:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583899.446384:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583899.446448:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:10514:x1871271580161536:12345-192.168.203.51@tcp:101:touch.500 Request processed in 1181us (1735us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784583899.457720:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1784583899.460611:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.460695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580161792 00000100:00100000:0.0:1784583899.460704:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580161792 00000100:00100000:0.0:1784583899.460767:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1784583899.460777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:10514:x1871271580161792:12345-192.168.203.51@tcp:36:touch.500 00010000:00010000:0.0:1784583899.460834:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583899.460860:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47b12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee247 expref: 10 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.460877:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b43e8ab900) 00010000:00010000:0.0:1784583899.460888:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583899.460941:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.460963:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.460982:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583899.461103:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7d7c2c4 reply state 000000009134c106 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.461115:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.461121:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583899.461124:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583899.461126:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583899.461227:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10514:x1871271580161792:12345-192.168.203.51@tcp:36:touch.500 Request processed in 451us (624us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784583899.461234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1784583899.463375:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.463528:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580161920 00000100:00100000:2.0:1784583899.463536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580161920 00000100:00100000:2.0:1784583899.463580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:2.0:1784583899.463589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:10514:x1871271580161920:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:2.0:1784583899.463611:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583899.463630:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47b27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee24e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.463682:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47b27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee24e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.463696:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47b27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee24e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.463711:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:2.0:1784583899.463714:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784583899.463717:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583899.463765:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:10514:x1871271580161920:12345-192.168.203.51@tcp:101:touch.500 Request processed in 177us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.463772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1784583899.467316:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.467406:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162048 00000100:00100000:2.0:1784583899.467415:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162048 00000100:00100000:2.0:1784583899.467463:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1784583899.467512:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580162048:12345-192.168.203.51@tcp:8:touch.500 00010000:00080000:2.0:1784583899.467558:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:2.0:1784583899.467588:0:8428:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e47b2e 00002000:00100000:2.0:1784583899.467599:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfe5cd00-263a-47c1-b0c6-0ab6049cb709/ffff98b30394d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784583899.467615:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784583899.467686:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784583899.467712:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b30394b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583899.467773:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580162048:12345-192.168.203.51@tcp:8:touch.500 Request processed in 261us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.467780:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784583899.470372:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.470581:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162176 00000100:00100000:2.0:1784583899.470591:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162176 00000100:00100000:2.0:1784583899.470665:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:2.0:1784583899.470676:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580162176:12345-192.168.203.51@tcp:2:touch.500 00000100:00080000:1.0:1784583899.470858:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784583899.481342:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1784583899.481357:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000100:00100000:0.0:1784583899.481699:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:0:x1871271580162176:12345-192.168.203.51@tcp:2:touch.500 Request processed in 11019us (11328us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784583899.481710:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:0.0:1784583899.484585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583899.484671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162432 00000100:00100000:1.0:1784583899.484681:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162432 00000100:00100000:1.0:1784583899.484761:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:1.0:1784583899.484772:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:10514:x1871271580162432:12345-192.168.203.51@tcp:35:touch.500 00000100:00100000:1.0:1784583899.485452:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:10514:x1871271580162432:12345-192.168.203.51@tcp:35:touch.500 Request processed in 613us (806us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784583899.485463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784583899.501825:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.502057:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162560 00000100:00100000:2.0:1784583899.502067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162560 00000100:00100000:2.0:1784583899.502127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1784583899.502138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:10515:x1871271580162560:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:2.0:1784583899.502651:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583899.502675:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee255 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502738:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502751:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502778:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583899.502819:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784583899.502823:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583899.502870:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502895:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee255 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502911:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee255 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.502918:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:2.0:1784583899.502921:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583899.502925:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784583899.504117:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:10515:x1871271580162560:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1974us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.504126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1784583899.509345:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.509670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162816 00000100:00100000:0.0:1784583899.509680:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162816 00000100:00100000:0.0:1784583899.509739:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1784583899.509749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:10515:x1871271580162816:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:0.0:1784583899.509770:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583899.509791:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee25c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583899.510118:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784583899.510223:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee25c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.510237:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:0.0:1784583899.510240:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583899.510245:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee25c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.510258:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1cc00, rc 0) 00000100:00100000:0.0:1784583899.511237:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:10515:x1871271580162816:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1482us (1894us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1784583899.511248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:1.0:1784583899.515905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.516033:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580162944 00000100:00100000:0.0:1784583899.516042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580162944 00000100:00100000:0.0:1784583899.516108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1784583899.516118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:10515:x1871271580162944:12345-192.168.203.51@tcp:37:rm.0 00000100:00100000:0.0:1784583899.521292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:10515:x1871271580162944:12345-192.168.203.51@tcp:37:rm.0 Request processed in 5165us (5385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583899.521307:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1784583899.526086:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.526384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580163200 00000100:00100000:0.0:1784583899.526395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580163200 00000100:00100000:0.0:1784583899.526463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784583899.526511:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:10515:x1871271580163200:12345-192.168.203.51@tcp:35:rm.0 00000100:00100000:0.0:1784583899.526753:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:10515:x1871271580163200:12345-192.168.203.51@tcp:35:rm.0 Request processed in 259us (674us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784583899.526773:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1784583899.546532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583899.546612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580163456 00000100:00100000:3.0:1784583899.546621:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580163456 00000100:00100000:3.0:1784583899.546679:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:3.0:1784583899.546689:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:10515:x1871271580163456:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:3.0:1784583899.546715:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583899.546734:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97600/0xdab2421a42e47b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee263 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.546855:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47b58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.546869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.546880:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583899.546891:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784583899.547052:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97600/0xdab2421a42e47b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee263 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.547082:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47b58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee263 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583899.547091:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:3.0:1784583899.547093:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583899.547097:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583899.547152:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580163456:12345-192.168.203.51@tcp:101:rm.0 Request processed in 464us (629us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784583899.547160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:1.0:1784583899.553589:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583899.553679:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580163584 00000100:00100000:2.0:1784583899.553690:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580163584 00000100:00100000:2.0:1784583899.553761:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1784583899.553770:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580163584:12345-192.168.203.51@tcp:41:rm.0 00000004:00000024:2.0:1784583899.553822:0:9809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1784583899.553889:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580163584:12345-192.168.203.51@tcp:41:rm.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.553913:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1784583899.559303:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583899.559450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580163712 00000100:00100000:3.0:1784583899.559460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580163712 00000100:00100000:2.0:1784583899.559666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:2.0:1784583899.559676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580163712:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:2.0:1784583899.559695:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583899.559714:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47b66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee26a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559779:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559804:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559820:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.559826:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560080:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560090:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560109:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583899.560144:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784583899.560148:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583899.560240:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560252:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560261:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560268:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560274:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560280:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.560284:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560291:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560303:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:2.0:1784583899.560306:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.560309:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560326:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47b6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560339:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560345:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560356:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ac00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583899.560359:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560365:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560373:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff98b43e8ab800) 00010000:00010000:2.0:1784583899.560376:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583899.560378:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560641:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47b74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560670:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47b66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee26a expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560684:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee26a expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583899.560698:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:2.0:1784583899.560700:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583899.560703:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784583899.560761:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:10515:x1871271580163712:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1086us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583899.560768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:1.0:1784583899.579294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.579401:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580163968 00000100:00100000:0.0:1784583899.579422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580163968 00000100:00100000:0.0:1784583899.579536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1784583899.579546:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:10515:x1871271580163968:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:0.0:1784583899.579601:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784583899.579626:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee26a expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579650:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47b27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee24e expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579661:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583899.579670:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e47b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee255 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579679:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:0.0:1784583899.579682:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583899.579703:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579717:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579726:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579738:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579759:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579766:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579863:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579872:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.579879:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784583899.580113:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784583899.580123:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342765654516ns, next at 343765651936ns, rc = 0 00010000:00010000:0.0:1784583899.580171:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580180:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580187:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580194:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580200:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580218:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580230:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784583899.580247:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580253:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580258:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580263:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ca00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.580268:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580274:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580282:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583899.580284:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784583899.580287:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580291:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47b90 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580304:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580309:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580321:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580325:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1cc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.580328:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580333:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580340:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:0.0:1784583899.580342:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583899.580344:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580349:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47b82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583899.580357:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000703af8b6 reply state 00000000919d5d26 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580367:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.580372:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff98b43e8ab800) 00010000:00010000:0.0:1784583899.580375:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583899.580377:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583899.580454:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580163968:12345-192.168.203.51@tcp:36:rm.0 Request processed in 907us (1167us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784583899.580462:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00010000:00010000:1.0:1784583899.581337:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583899.581345:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.581353:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583899.581356:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.581363:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.581376:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:1.0:1784583899.581379:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784583899.581382:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.581387:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47b97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.581400:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583899.581402:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583899.581411:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583899.592193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583899.592399:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164224 00000100:00100000:0.0:1784583899.592408:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164224 00000100:00100000:0.0:1784583899.592506:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:0.0:1784583899.592515:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580164224:12345-192.168.203.51@tcp:35:rm.0 00000100:00100000:0.0:1784583899.592705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:10515:x1871271580164224:12345-192.168.203.51@tcp:35:rm.0 Request processed in 190us (521us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784583899.592712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1784583899.601966:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583899.603845:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164480 00000100:00100000:1.0:1784583899.603859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164480 00000100:00100000:1.0:1784583899.603938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:1.0:1784583899.603949:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:10515:x1871271580164480:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:1.0:1784583899.604311:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784583899.604337:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47b58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee263 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.604371:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e47af6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee240 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.604392:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b408769b00) 00010000:00010000:1.0:1784583899.604416:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ce00/0xdab2421a42e47ab7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee232 expref: 17 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.604427:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b408769f00) 00010000:00010000:1.0:1784583899.604433:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583899.604457:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.604845:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583899.604859:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605320:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605331:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605339:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605435:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605444:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.605451:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583899.606595:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784583899.606616:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606625:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606650:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606656:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ca00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.606661:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606668:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606681:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98b301fd1200) 00010000:00010000:0.0:1784583899.606684:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784583899.606688:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606694:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47bac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606717:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606724:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606730:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606735:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cee00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583899.606738:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606754:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606762:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303809d00) 00010000:00010000:0.0:1784583899.606764:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583899.606767:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606774:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e47b9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583899.606786:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f514bf06 reply state 000000004c76fd19 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606796:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583899.606802:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b301fd1b00) 00010000:00010000:0.0:1784583899.606804:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583899.606807:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583899.607374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:10515:x1871271580164480:12345-192.168.203.51@tcp:36:rm.0 Request processed in 3412us (5410us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784583899.607390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:1.0:1784583900.244740:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244802:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583900.244977:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164736 00000100:00100000:1.0:1784583900.244988:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164736 00000100:00100000:1.0:1784583900.245030:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165248 00000100:00100000:1.0:1784583900.245034:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165248 00000100:00100000:1.0:1784583900.245058:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164864 00000100:00100000:1.0:1784583900.245061:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164864 00000100:00100000:1.0:1784583900.245072:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165120 00000100:00100000:1.0:1784583900.245075:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165120 00000100:00100000:1.0:1784583900.245101:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1784583900.245110:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2401:x1871271580164736:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583900.245183:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2401:x1871271580164736:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 74us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583900.245191:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1784583900.245206:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:1.0:1784583900.245212:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580165248:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583900.245239:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580165248:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583900.245246:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:1.0:1784583900.245257:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:1.0:1784583900.245263:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580164864:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583900.245285:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580164864:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583900.245300:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:1.0:1784583900.245312:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:1.0:1784583900.245318:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580165120:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583900.245344:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580165120:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583900.245349:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:1.0:1784583900.245369:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164608 00000100:00100000:1.0:1784583900.245373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164608 00000100:00100000:1.0:1784583900.245399:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 330 00000100:00100000:1.0:1784583900.245404:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580164608:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583900.245427:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580164608:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583900.245433:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 330 00000100:00080000:1.0:1784583900.245464:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583900.245509:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583900.245781:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580164992 00000100:00100000:3.0:1784583900.245786:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580164992 00000100:00100000:3.0:1784583900.245823:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:3.0:1784583900.245830:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580164992:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583900.245859:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580164992:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583900.245866:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:3.0:1784583900.334274:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599115520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583900.334347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583900.334407:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583900.334414:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599115648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583900.334438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583900.334501:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115520 00000100:00100000:3.0:1784583900.334520:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115520 00000100:00100000:3.0:1784583900.334569:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115648 00000100:00100000:3.0:1784583900.334572:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115648 00000100:00100000:3.0:1784583900.334588:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784583900.334596:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599115520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583900.334625:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583900.334664:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599115520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583900.334670:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784583900.334685:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784583900.334690:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599115648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583900.334699:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583900.334720:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599115648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583900.334725:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1784583900.334742:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583900.334746:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784583900.334789:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bbd180 x1871271599115648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583900.334807:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599115648:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784583900.334818:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bbfb80 x1871271599115520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583900.334829:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599115520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583900.335104:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784583900.335115:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599115776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583900.335148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.335752:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599115904:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.335793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.335832:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115904 00000100:00100000:0.0:1784583900.335838:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115904 00000100:00100000:0.0:1784583900.335872:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1784583900.335880:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599115904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.335935:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599115904:12345-0@lo:400:kworker.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.335942:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1784583900.335993:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599115904:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336023:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583900.336031:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599116032:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.336078:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116032 00000100:00100000:0.0:1784583900.336081:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116032 00000100:00100000:0.0:1784583900.336190:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784583900.336197:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336233:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599116032:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.336240:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784583900.336270:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599116032:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336299:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599116160:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.336351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116160 00000100:00100000:0.0:1784583900.336355:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116160 00000100:00100000:0.0:1784583900.336396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784583900.336403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599116160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336438:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599116160:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.336445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784583900.336498:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599116160:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336536:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583900.336542:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599116288:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.336583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116288 00000100:00100000:0.0:1784583900.336587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116288 00000100:00100000:0.0:1784583900.336609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784583900.336614:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599116288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336649:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599116288:12345-0@lo:400:kworker.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.336654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784583900.336688:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599116288:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336722:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599116416:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.336766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116416 00000100:00100000:0.0:1784583900.336770:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116416 00000100:00100000:0.0:1784583900.336786:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784583900.336791:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599116416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599116416:12345-0@lo:400:kworker.0 Request processed in 33us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.336830:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784583900.336851:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599116416:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336877:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583900.336883:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599116544:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.336906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784583900.336953:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583900.336981:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599115776 00000100:00100000:2.0:1784583900.336985:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599115776 00000100:00100000:2.0:1784583900.337018:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784583900.337024:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599115776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583900.337039:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583900.337078:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599115776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583900.337084:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1784583900.337564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784583900.337938:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304129500 x1871271599115776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583900.338040:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599115776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583900.338187:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116544 00000100:00100000:2.0:1784583900.338193:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116544 00000100:00100000:2.0:1784583900.338231:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784583900.338238:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599116544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583900.338281:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599116544:12345-0@lo:400:kworker.0 Request processed in 43us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583900.338297:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1784583900.338312:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583900.338318:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583900.338327:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599116672:0@lo:400:kworker.0 00000100:00100000:2.0:1784583900.338356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.338548:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599116544:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338569:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116672 00000100:00100000:0.0:1784583900.338572:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116672 00000100:00100000:0.0:1784583900.338601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784583900.338608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599116672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599116672:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.338651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:0.0:1784583900.338679:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b404957100 x1871271599116672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583900.338688:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599116672:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338727:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599116800:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.338783:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116800 00000100:00100000:0.0:1784583900.338787:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116800 00000100:00100000:0.0:1784583900.338816:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784583900.338822:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599116800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338856:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599116800:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.338861:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1784583900.338884:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b404957100 x1871271599116800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583900.338891:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599116800:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338929:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599116928:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.338951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784583900.339057:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784583900.339060:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583900.340543:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599116928 00000100:00100000:0.0:1784583900.340552:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599116928 00000100:00100000:0.0:1784583900.340603:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784583900.340612:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599116928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.340672:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599116928:12345-0@lo:400:kworker.0 Request processed in 62us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.340679:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1784583900.340700:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583900.340711:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599117056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583900.340743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.340788:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599116928:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.340828:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599117184:0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.340853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.340877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117184 00000100:00100000:0.0:1784583900.340881:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117184 00000100:00100000:0.0:1784583900.340908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784583900.340913:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599117184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583900.340944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599117184:12345-0@lo:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.340950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1784583900.342193:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784583900.342462:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b40a51e300 x1871271599117184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583900.342503:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599117184:0@lo:400:kworker.0 00000100:00100000:2.0:1784583900.343578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117056 00000100:00100000:2.0:1784583900.343589:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117056 00000100:00100000:2.0:1784583900.343648:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784583900.343659:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599117056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583900.343683:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583900.343758:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599117056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583900.343765:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1784583900.343805:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304129880 x1871271599117056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583900.343825:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599117056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583900.866310:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583900.866345:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599117312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583900.866413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583900.866646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117312 00000100:00100000:0.0:1784583900.866654:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117312 00000100:00100000:0.0:1784583900.866701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784583900.866710:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599117312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583900.866745:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583900.866810:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599117312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583900.866817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784583900.873222:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599117312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583901.360029:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583902.383774:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583903.405604:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784583903.501816:0:13674:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1784583903.931673:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583903.931696:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599117440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583903.931762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583903.934939:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117440 00000100:00100000:0.0:1784583903.934955:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117440 00000100:00100000:0.0:1784583903.935030:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784583903.935041:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599117440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583903.935081:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583903.935164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599117440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583903.935171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784583903.935221:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599117440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583904.430264:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784583904.819841:0:13722:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4c6837b0 20000000:00000080:1.0:1784583904.819859:0:13722:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b303b28c00 uarg=0000000000000000 20000000:01000000:1.0:1784583904.821037:0:13722:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784583904.821044:0:13722:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784583904.821049:0:13722:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1784583904.829296:0:13723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1784583904.829572:0:13722:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1784583904.835868:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1784583904.835935:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1784583904.835952:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1784583904.835966:0:13722:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784583904.835985:0:13722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836020:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836039:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836048:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836054:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836061:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836068:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836075:0:13722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836114:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836126:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 23 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836139:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117568:0@lo:104: 00000100:00100000:0.0:1784583904.836202:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583904.836289:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836298:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 23 pid: 6508 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836307:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117696:0@lo:104: 00010000:00010000:0.0:1784583904.836333:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836340:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 23 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836347:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117824:0@lo:104: 00010000:00010000:0.0:1784583904.836369:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836376:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836384:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117952:0@lo:104: 00010000:00010000:0.0:1784583904.836408:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836418:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836426:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599118080:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583904.836532:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.836546:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 12 pid: 6508 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.836555:0:13722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599118208:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583904.836578:0:13722:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52480 going to sleep for 11 seconds 00000100:00100000:2.0:1784583904.836666:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784583904.836685:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.836718:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.836728:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.836739:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117568 00000100:00100000:2.0:1784583904.836746:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117568 00000100:00100000:2.0:1784583904.836783:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117696 00000100:00100000:2.0:1784583904.836786:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117696 00000100:00100000:2.0:1784583904.836795:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117824 00000100:00100000:2.0:1784583904.836797:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117824 00000100:00100000:2.0:1784583904.836805:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599117952 00000100:00100000:2.0:1784583904.836807:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599117952 00000100:00100000:2.0:1784583904.836818:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784583904.836826:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:13722:x1871271599117568:12345-0@lo:104: 00010000:00010000:2.0:1784583904.836837:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.836886:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784583904.836892:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+6:13722:x1871271599117568:12345-0@lo:104: Request processed in 67us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.836899:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784583904.836939:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583904.836946:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:13722:x1871271599117696:12345-0@lo:104: 00010000:00010000:2.0:1784583904.836954:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.836983:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784583904.836988:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+5:13722:x1871271599117696:12345-0@lo:104: Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.836994:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784583904.837005:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583904.837010:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:13722:x1871271599117824:12345-0@lo:104: 00010000:00010000:2.0:1784583904.837023:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837051:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784583904.837056:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+4:13722:x1871271599117824:12345-0@lo:104: Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.837062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784583904.837073:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784583904.837078:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13722:x1871271599117952:12345-0@lo:104: 00010000:00010000:2.0:1784583904.837085:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837109:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784583904.837113:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48a91d92-bcef-47e2-812f-ada1e5d741c7+3:13722:x1871271599117952:12345-0@lo:104: Request processed in 36us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.837119:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1784583904.837134:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784583904.837138:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837146:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583904.837149:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837158:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583904.837165:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583904.837177:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784583904.837201:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837208:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583904.837227:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837234:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96800/0xdab2421a42e47a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a7f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837247:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784583904.837250:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837255:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583904.837258:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837264:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583904.837269:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583904.837274:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784583904.837287:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837292:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583904.837304:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837310:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e47a6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837320:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784583904.837325:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837330:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583904.837332:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837338:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583904.837344:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583904.837348:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784583904.837361:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837366:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583904.837381:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837386:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce600/0xdab2421a42e47a5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837394:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583904.837403:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837408:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583904.837411:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837417:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583904.837422:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583904.837426:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784583904.837439:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837443:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583904.837449:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837455:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1c200/0xdab2421a42e47a4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e47a55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837494:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583904.837496:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583904.837498:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583904.837509:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599118336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.837536:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.837556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583904.837561:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599118464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.837589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.837615:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599118592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.837636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.837653:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583904.837657:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599118720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.837676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.837703:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118336 00000100:00100000:2.0:1784583904.837708:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118336 00010000:00010000:2.0:1784583904.837725:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 24 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583904.837740:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118464 00000100:00100000:2.0:1784583904.837743:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118464 00010000:00010000:2.0:1784583904.837753:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 25 pid: 6508 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583904.837762:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118592 00000100:00100000:2.0:1784583904.837764:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118592 00010000:00010000:2.0:1784583904.837773:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 26 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583904.837782:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118720 00000100:00100000:2.0:1784583904.837784:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118720 00010000:00010000:2.0:1784583904.837793:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 27 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583904.837805:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784583904.837810:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+27:3641:x1871271599118336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583904.837819:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583904.837824:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 27 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837840:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 27 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837853:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583904.837881:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+27:3641:x1871271599118336:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.837888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784583904.837902:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583904.837907:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+26:3641:x1871271599118464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583904.837915:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583904.837919:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 26 pid: 6508 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837928:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 26 pid: 6508 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837937:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583904.837957:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+26:3641:x1871271599118464:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.837963:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784583904.837974:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784583904.837980:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3639:x1871271599118592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583904.837987:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583904.837991:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 25 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.837998:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 25 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.838014:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583904.838041:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+25:3639:x1871271599118592:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.838047:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784583904.838059:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784583904.838065:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599118720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583904.838072:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583904.838077:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 24 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.838086:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 24 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.838094:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583904.838113:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599118720:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583904.838119:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784583904.838156:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599118720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.838164:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599118592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.838187:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599118464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583904.838195:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599118336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784583904.838362:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d400/0xdab2421a42e47a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47a78 expref: 23 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.838372:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117568:0@lo:104: 00010000:00010000:0.0:1784583904.838380:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d000/0xdab2421a42e47a71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47a6a expref: 22 pid: 6508 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.838386:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117696:0@lo:104: 00010000:00010000:0.0:1784583904.838392:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96000/0xdab2421a42e47a63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47a5c expref: 21 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.838398:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117824:0@lo:104: 00010000:00010000:0.0:1784583904.838406:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96e00/0xdab2421a42e47a55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e47a4e expref: 20 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.838412:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599117952:0@lo:104: 00010000:00010000:3.0:1784583904.838887:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784583904.849949:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1784583904.849968:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784583904.850153:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583904.850174:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599118848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784583904.850253:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583904.850654:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118848 00000100:00100000:2.0:1784583904.850661:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118848 00000100:00100000:2.0:1784583904.850717:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784583904.850727:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599118848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784583904.850759:0:8805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1784583904.850790:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a5e96db, atime: 0x6a5e96db, ctime: 0x6a5e96db, blocks: 0x0 00010000:00010000:2.0:1784583904.850798:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.850823:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1784583904.850827:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583904.850833:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.850850:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.850860:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583904.850868:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784583904.850999:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784583904.851040:0:8805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784583904.851141:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583904.851150:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.851160:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583904.851165:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.851176:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.851195:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.851203:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.851223:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583904.851225:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583904.851226:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583904.851288:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599118848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 562us (1036us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784583904.851296:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784583904.855452:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855511:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855518:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855524:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583904.855529:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855537:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855556:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff98b43e8ab800) 00010000:00010000:1.0:1784583904.855559:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583904.855563:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855569:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47b0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855592:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855598:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855603:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855608:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1dc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583904.855617:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855624:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855632:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:1.0:1784583904.855635:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583904.855637:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855643:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47b20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855660:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855666:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855672:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855677:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583904.855679:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855684:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855691:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff98b43e8ab800) 00010000:00010000:1.0:1784583904.855693:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583904.855701:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855707:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c600/0xdab2421a42e47b89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855722:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855728:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855734:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855740:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1cc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583904.855742:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855747:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855754:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98b301fd1b00) 00010000:00010000:1.0:1784583904.855757:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583904.855759:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583904.855766:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1cc00/0xdab2421a42e47ba5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784583904.857000:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b42f7a1f80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1784583904.857011:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599118848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784583904.858261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583904.858303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583904.858423:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165376 00000100:00100000:3.0:1784583904.858430:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165376 00010000:00010000:3.0:1784583904.858505:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 13 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583904.858535:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165504 00000100:00100000:3.0:1784583904.858539:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165504 00010000:00010000:3.0:1784583904.858550:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 14 pid: 6508 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583904.858589:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583904.858598:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+14:2400:x1871271580165376:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583904.858613:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583904.858619:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 14 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858631:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 14 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858650:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583904.858693:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+14:2400:x1871271580165376:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 95us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583904.858701:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583904.858716:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1784583904.858723:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580165504:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583904.858731:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583904.858737:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 13 pid: 6508 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858746:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 13 pid: 6508 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858758:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858767:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858789:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858796:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858804:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858812:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858819:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ce00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583904.858824:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858833:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858841:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583904.858850:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583904.858869:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580165504:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 146us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583904.858877:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00010000:00010000:0.0:1784583904.859234:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a400/0xdab2421a42e47a47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee224 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.859247:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599118080:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583904.859260:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cf000/0xdab2421a42e47a40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee21d expref: 11 pid: 6508 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583904.859267:0:13722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40a51e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1871271599118208:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583904.859307:0:13722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.859317:0:13722:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.859324:0:13722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583904.859331:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bb3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583905.365182:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365218:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365276:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365342:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583905.365369:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165888 00000100:00100000:3.0:1784583905.365378:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165888 00000100:00100000:3.0:1784583905.365424:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166144 00000100:00100000:3.0:1784583905.365428:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166144 00000100:00100000:3.0:1784583905.365439:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165760 00000100:00100000:3.0:1784583905.365441:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165760 00000100:00100000:3.0:1784583905.365452:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166272 00000100:00100000:3.0:1784583905.365483:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166272 00000100:00100000:3.0:1784583905.365502:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:3.0:1784583905.365511:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580165888:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583905.365579:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580165888:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.365587:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:3.0:1784583905.365603:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:3.0:1784583905.365610:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580166144:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583905.365632:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580166144:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.365637:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:3.0:1784583905.365647:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:3.0:1784583905.365652:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580165760:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583905.365671:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580165760:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 19us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.365677:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:3.0:1784583905.365688:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:3.0:1784583905.365700:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580166272:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583905.365727:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580166272:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.365734:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:3.0:1784583905.365759:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166016 00000100:00100000:3.0:1784583905.365762:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166016 00000100:00100000:3.0:1784583905.365791:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1784583905.365798:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580166016:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583905.365824:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580166016:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.365830:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00080000:3.0:1784583905.365849:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784583905.365853:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583905.365855:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583905.373014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580165632 00000100:00100000:0.0:1784583905.373028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580165632 00000100:00100000:0.0:1784583905.373109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 332 00000100:00100000:0.0:1784583905.373120:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:2400:x1871271580165632:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583905.373212:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+11:2400:x1871271580165632:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 93us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583905.373236:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 332 00000100:00100000:2.0:1784583905.453819:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599119104:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.453942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.453997:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599119616:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.454040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.454066:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599120128:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.454087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.454112:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784583905.454118:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599119232:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.454138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.454154:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599119744:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.454172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.454185:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599120256:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.454206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583905.454236:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119104 00000100:00100000:2.0:1784583905.454242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119104 00000100:00100000:0.0:1784583905.454540:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599118976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583905.454572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583905.454592:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599119488:0@lo:400:kworker.0 00000100:00100000:0.0:1784583905.454613:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583905.454630:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599120000:0@lo:400:kworker.0 00000100:00100000:0.0:1784583905.454650:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583905.454661:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784583905.454666:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599119360:0@lo:400:kworker.0 00000100:00100000:0.0:1784583905.454684:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583905.454694:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599119872:0@lo:400:kworker.0 00000100:00100000:0.0:1784583905.454711:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583905.454726:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599120384:0@lo:400:kworker.0 00000100:00100000:0.0:1784583905.454742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583905.454859:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119616 00000100:00100000:1.0:1784583905.454870:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119616 00000100:00100000:1.0:1784583905.454970:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120128 00000100:00100000:1.0:1784583905.454974:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120128 00000100:00100000:1.0:1784583905.454987:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119744 00000100:00100000:1.0:1784583905.454989:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119744 00000100:00100000:1.0:1784583905.455000:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120000 00000100:00100000:1.0:1784583905.455002:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120000 00000100:00100000:1.0:1784583905.455012:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119360 00000100:00100000:1.0:1784583905.455014:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119360 00000100:00100000:1.0:1784583905.455026:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784583905.455034:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599119616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455090:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599119616:12345-0@lo:400:kworker.0 Request processed in 56us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583905.455097:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784583905.455113:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784583905.455118:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599120128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455142:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599120128:12345-0@lo:400:kworker.0 Request processed in 24us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583905.455148:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784583905.455159:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784583905.455164:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599119744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455187:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599119744:12345-0@lo:400:kworker.0 Request processed in 23us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583905.455192:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784583905.455202:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784583905.455207:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599120000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455233:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599120000:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583905.455244:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784583905.455255:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784583905.455260:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599119360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455287:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599119360:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583905.455292:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784583905.455323:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599119360:0@lo:400:kworker.0 00000100:00100000:1.0:1784583905.455332:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599120000:0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.455450:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120256 00000100:00100000:3.0:1784583905.455482:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120256 00000100:00100000:3.0:1784583905.455508:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119872 00000100:00100000:3.0:1784583905.455511:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119872 00000100:00100000:3.0:1784583905.455525:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120384 00000100:00100000:3.0:1784583905.455528:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120384 00000100:00100000:3.0:1784583905.455539:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583905.455544:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599120256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.455577:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599120256:12345-0@lo:400:kworker.0 Request processed in 32us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.455583:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784583905.455595:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784583905.455600:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599119872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.455637:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599119872:12345-0@lo:400:kworker.0 Request processed in 36us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.455643:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784583905.455653:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784583905.455658:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599120384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.455684:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599120384:12345-0@lo:400:kworker.0 Request processed in 25us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.455689:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:3.0:1784583905.455704:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583905.455737:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583905.455746:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599120512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583905.455772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583905.455799:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599118976 00000100:00100000:3.0:1784583905.455803:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599118976 00000100:00100000:3.0:1784583905.455821:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120512 00000100:00100000:3.0:1784583905.455824:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120512 00000100:00100000:3.0:1784583905.455833:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784583905.455838:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599118976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583905.455856:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784583905.455967:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583905.455971:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583905.455973:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583905.455975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583905.456085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784583905.456093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599119104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.456507:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599119104:12345-0@lo:400:kworker.0 Request processed in 33us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583905.456518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784583905.456545:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119232 00000100:00100000:2.0:1784583905.456549:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119232 00000100:00100000:2.0:1784583905.456567:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599119488 00000100:00100000:2.0:1784583905.456570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599119488 00000100:00100000:2.0:1784583905.456583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784583905.456589:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599119232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.456626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599119232:12345-0@lo:400:kworker.0 Request processed in 36us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583905.456632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784583905.456654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784583905.456661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599119488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.456690:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599119488:12345-0@lo:400:kworker.0 Request processed in 30us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583905.456697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784583905.456747:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784583905.456755:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599120512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583905.456766:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583905.456798:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599120512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583905.456805:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784583905.456832:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599120640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583905.456859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583905.458009:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599118976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2166us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.458020:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784583905.458040:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120640 00000100:00100000:3.0:1784583905.458046:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120640 00000100:00100000:3.0:1784583905.458069:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784583905.458075:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599120640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583905.458096:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583905.458143:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599120640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.458149:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784583905.458176:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599120768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583905.458204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583905.458266:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599120512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583905.458298:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599119872:0@lo:400:kworker.0 00010000:00080000:3.0:1784583905.458313:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c7800 x1871271599120384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583905.458324:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599120384:0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.458341:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599118976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583905.458352:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599119488:0@lo:400:kworker.0 00000100:00100000:3.0:1784583905.458375:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120768 00000100:00100000:3.0:1784583905.458378:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120768 00000100:00100000:3.0:1784583905.458398:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784583905.458404:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599120768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583905.458413:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583905.458440:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599120768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.458446:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1784583905.458498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c4700 x1871271599120768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583905.458510:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599120768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583905.459997:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599119232:0@lo:400:kworker.0 00010000:00080000:2.0:1784583905.460022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c7b80 x1871271599119744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583905.460038:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599119744:0@lo:400:kworker.0 00010000:00080000:2.0:1784583905.460050:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c5f80 x1871271599120256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583905.460057:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599120256:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.460069:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599119104:0@lo:400:kworker.0 00000100:00100000:2.0:1784583905.460080:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599119616:0@lo:400:kworker.0 00010000:00080000:2.0:1784583905.460091:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c7100 x1871271599120128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583905.460112:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599120128:0@lo:400:kworker.0 00010000:00080000:2.0:1784583905.460153:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424000 x1871271599120640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583905.460169:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599120640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583905.966588:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583905.966610:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599120896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583905.966678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583905.966809:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599120896 00000100:00100000:3.0:1784583905.966816:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599120896 00000100:00100000:3.0:1784583905.966862:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784583905.966870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599120896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583905.966900:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784583905.967144:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599120896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 274us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583905.967152:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784583905.969847:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599120896:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1784583906.002843:0:13772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd7bc15a0 20000000:00000080:0.0:1784583906.002858:0:13772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b303838000 uarg=0000000000000000 20000000:01000000:0.0:1784583906.002894:0:13772:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1784583906.002905:0:13772:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1784583906.002910:0:13772:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1784583906.003385:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1784583906.003728:0:13772:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1784583906.003803:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1784583906.003828:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1784583906.003841:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1784583906.003849:0:13772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784583906.003867:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003883:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003893:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003901:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003908:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003915:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003922:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ce00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583906.003926:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003934:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003958:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003966:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.003972:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1ce00/0xdab2421a42e47bc1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583906.034011:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784583906.034019:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b30245a800 from 7 10000000:01000000:0.0:1784583906.034024:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784583906.034068:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.034080:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.034090:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583906.034115:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.034176:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.034237:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caedb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583906.034428:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121024 00000100:00100000:3.0:1784583906.034435:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121024 00000100:00100000:3.0:1784583906.034518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784583906.034528:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:6510:x1871271599121024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784583906.034540:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583906.034554:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97e00/0xdab2421a42e47bcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47bc8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.034575:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97e00/0xdab2421a42e47bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47bc8 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.034585:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97e00/0xdab2421a42e47bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47bc8 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.034594:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97e00, rc 0) 00000100:00100000:3.0:1784583906.034632:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583906.034639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1784583906.035301:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583906.035316:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.035325:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583906.035401:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.035437:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.035485:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caedb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583906.035650:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121152 00000100:00100000:3.0:1784583906.035655:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121152 00000100:00100000:3.0:1784583906.035698:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784583906.035706:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.035831:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583906.035839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784583906.035870:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.035898:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437680700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.035935:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583906.035966:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583906.035977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121280 00000100:00100000:3.0:1784583906.035980:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121280 00000100:00100000:3.0:1784583906.036003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784583906.036009:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.036080:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583906.036087:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784583906.036124:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437680700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.036281:0:13775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437680700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13775:1871271599121408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583906.036311:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583906.036328:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121408 00000100:00100000:3.0:1784583906.036331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121408 00000100:00100000:3.0:1784583906.036350:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1784583906.036355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:13775:x1871271599121408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.037678:0:13775:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583906.037950:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:13775:x1871271599121408:12345-0@lo:502:llog_process_th.0 Request processed in 1591us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.038660:0:13775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437680700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13775:1871271599121408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784583906.038693:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583906.038703:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.038705:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784583906.038711:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b30245a800 00000020:00000080:0.0:1784583906.038714:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784583906.038769:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583906.038773:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.038774:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784583906.038777:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583906.038779:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.038781:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784583906.038784:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b30245a800 00000020:00000080:0.0:1784583906.038786:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784583906.038839:0:13775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13775:1871271599121536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.038886:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.038912:0:13775:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caedb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784583906.040751:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1784583906.041025:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121536 00000100:00100000:3.0:1784583906.041032:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121536 00000100:00100000:3.0:1784583906.041073:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1784583906.041080:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:13775:x1871271599121536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784583906.041205:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:13775:x1871271599121536:12345-0@lo:502:llog_process_th.0 Request processed in 125us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583906.041211:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784583906.043836:0:13775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13775:1871271599121536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784583906.043874:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583906.043882:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.043884:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784583906.043888:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784583906.044923:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784583906.044951:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784583906.045017:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.045029:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583906.045039:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784583906.045042:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b43e967000 from 7 10000000:01000000:3.0:1784583906.045044:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784583906.045076:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.045083:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583906.045093:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583906.045115:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784583906.045189:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583906.045231:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e708900 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.051976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121664 00000100:00100000:1.0:1784583906.051991:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121664 00000100:00100000:1.0:1784583906.052053:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1784583906.052062:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:6510:x1871271599121664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583906.052080:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583906.052096:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172ce800/0xdab2421a42e47bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47bd6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.052124:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce800/0xdab2421a42e47bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47bd6 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.052135:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172ce800/0xdab2421a42e47bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47bd6 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.052145:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce800, rc 0) 00000100:00100000:1.0:1784583906.052216:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599121664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.052223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1784583906.052283:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583906.052300:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.052310:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583906.052382:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.052414:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.052440:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583906.052878:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121792 00000100:00100000:0.0:1784583906.052889:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121792 00000100:00100000:0.0:1784583906.052915:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1784583906.052922:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599121792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.053029:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599121792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.053037:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1784583906.055687:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.055743:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.055817:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.055849:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402ff1300 going to sleep for 11 seconds 00000100:00100000:0.0:1784583906.055869:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599121920 00000100:00100000:0.0:1784583906.055873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599121920 00000100:00100000:0.0:1784583906.055911:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1784583906.055919:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599121920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.056020:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599121920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.056027:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1784583906.056071:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599121920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.056232:0:13777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13777:1871271599122048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.056264:0:13777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.056280:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122048 00000100:00100000:0.0:1784583906.056284:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122048 00000100:00100000:0.0:1784583906.056302:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1784583906.056308:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:13777:x1871271599122048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.056371:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:13777:x1871271599122048:12345-0@lo:502:llog_process_th.0 Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.056396:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1784583906.056637:0:13777:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43caedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583906.056651:0:13777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13777:1871271599122048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784583906.056673:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583906.056682:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.056684:0:13777:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784583906.056690:0:13777:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b43e967000 00000020:00000080:0.0:1784583906.056693:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784583906.056760:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583906.056764:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.056766:0:13777:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784583906.056769:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784583906.056771:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.056773:0:13777:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784583906.056776:0:13777:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b43e967000 00000020:00000080:0.0:1784583906.056778:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784583906.056809:0:13777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13777:1871271599122176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.056840:0:13777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.056857:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122176 00000100:00100000:0.0:1784583906.056860:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122176 00000100:00100000:0.0:1784583906.056880:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784583906.056887:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:13777:x1871271599122176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784583906.056941:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:13777:x1871271599122176:12345-0@lo:502:llog_process_th.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.056947:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784583906.056986:0:13777:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583906.056997:0:13777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13777:1871271599122176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784583906.057019:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784583906.057023:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784583906.057025:0:13777:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784583906.057028:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1784583906.057071:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1784583906.057089:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784583906.057099:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057109:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583906.057120:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784583906.057123:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b42ba2f000 from 7 10000000:01000000:0.0:1784583906.057126:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784583906.057146:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057154:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057162:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583906.057175:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.057200:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.057213:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583906.057224:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122304 00000100:00100000:0.0:1784583906.057227:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122304 00000100:00100000:0.0:1784583906.057246:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784583906.057258:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:6510:x1871271599122304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583906.057266:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583906.057277:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c600/0xdab2421a42e47beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47be4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057297:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c600/0xdab2421a42e47beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47be4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057306:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c600/0xdab2421a42e47beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47be4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057314:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c600, rc 0) 00000100:00100000:0.0:1784583906.057340:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.057346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784583906.057372:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784583906.057395:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583906.057404:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583906.059739:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.061293:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.061344:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.063006:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122432 00000100:00100000:1.0:1784583906.063018:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122432 00000100:00100000:1.0:1784583906.063077:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784583906.063088:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.063236:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.063245:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784583906.063953:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.064592:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.064670:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583906.064706:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.065062:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122560 00000100:00100000:1.0:1784583906.065068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122560 00000100:00100000:1.0:1784583906.065108:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784583906.065116:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.065215:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.065221:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1784583906.066729:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.069741:0:13780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13780:1871271599122688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583906.069814:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.069855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122688 00000100:00100000:1.0:1784583906.069860:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122688 00000100:00100000:1.0:1784583906.069898:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1784583906.069907:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:13780:x1871271599122688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583906.070008:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:13780:x1871271599122688:12345-0@lo:502:llog_process_th.0 Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.070016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1784583906.070065:0:13780:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.070083:0:13780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13780:1871271599122688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583906.070107:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583906.070116:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583906.070118:0:13780:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784583906.070125:0:13780:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b42ba2f000 00000020:00000080:1.0:1784583906.070127:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784583906.070174:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583906.070423:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583906.070426:0:13780:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784583906.070431:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784583906.070434:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583906.070435:0:13780:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784583906.070439:0:13780:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b42ba2f000 00000020:00000080:1.0:1784583906.070441:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784583906.070681:0:13780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13780:1871271599122816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583906.070716:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.070739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122816 00000100:00100000:1.0:1784583906.070743:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122816 00000100:00100000:1.0:1784583906.070766:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1784583906.070774:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:13780:x1871271599122816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784583906.070835:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:13780:x1871271599122816:12345-0@lo:502:llog_process_th.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.070846:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1784583906.070874:0:13780:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.070887:0:13780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13780:1871271599122816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784583906.070903:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784583906.070906:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784583906.070908:0:13780:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784583906.070911:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784583906.070965:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1784583906.070984:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784583906.070993:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071005:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583906.071015:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784583906.071018:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b418942800 from 7 10000000:01000000:1.0:1784583906.071020:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784583906.071042:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071049:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071058:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583906.071071:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071097:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.071128:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.071140:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599122944 00000100:00100000:1.0:1784583906.071143:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599122944 00000100:00100000:1.0:1784583906.071163:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784583906.071169:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:6510:x1871271599122944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583906.071176:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583906.071188:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172ce000/0xdab2421a42e47bf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e47bf2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071206:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce000/0xdab2421a42e47bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e47bf2 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071216:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172ce000/0xdab2421a42e47bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e47bf2 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071225:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce000, rc 0) 00000100:00100000:1.0:1784583906.071251:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599122944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.071256:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784583906.071284:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599122944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784583906.071296:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583906.071305:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583906.071346:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599123072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071368:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.071386:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.071396:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123072 00000100:00100000:1.0:1784583906.071400:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123072 00000100:00100000:1.0:1784583906.071418:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784583906.071424:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599123072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071529:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599123072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.071535:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784583906.071560:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599123072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071584:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599123200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071618:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583906.071629:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583906.071639:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123200 00000100:00100000:1.0:1784583906.071642:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123200 00000100:00100000:1.0:1784583906.071660:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784583906.071666:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599123200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.071728:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:6510:x1871271599123200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.071734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784583906.071767:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48a91d92-bcef-47e2-812f-ada1e5d741c7:6510:1871271599123200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784583906.077782:0:13781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13781:1871271599123328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583906.077864:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583906.077902:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123328 00000100:00100000:2.0:1784583906.077910:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123328 00000100:00100000:2.0:1784583906.077951:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784583906.077960:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:13781:x1871271599123328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583906.078066:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:13781:x1871271599123328:12345-0@lo:502:llog_process_th.0 Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.078073:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784583906.078118:0:13781:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40510bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583906.078138:0:13781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13781:1871271599123328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784583906.078161:0:13781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583906.078169:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583906.078171:0:13781:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784583906.078179:0:13781:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b418942800 00000020:00000080:2.0:1784583906.078181:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784583906.078229:0:13781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583906.078448:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583906.078462:0:13781:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784583906.078485:0:13781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784583906.078495:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583906.078497:0:13781:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784583906.078502:0:13781:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b418942800 00000020:00000080:2.0:1784583906.078504:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784583906.078715:0:13781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13781:1871271599123456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583906.078750:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583906.078772:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123456 00000100:00100000:2.0:1784583906.078776:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123456 00000100:00100000:2.0:1784583906.078799:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784583906.078806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:13781:x1871271599123456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784583906.078868:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:13781:x1871271599123456:12345-0@lo:502:llog_process_th.0 Request processed in 62us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.078875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784583906.078901:0:13781:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40510bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583906.078914:0:13781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48a91d92-bcef-47e2-812f-ada1e5d741c7:13781:1871271599123456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784583906.078929:0:13781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784583906.078933:0:13781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784583906.078934:0:13781:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784583906.078938:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784583906.078983:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1784583906.079006:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784583906.079016:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.079026:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784583906.101063:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784583906.140517:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784583906.480766:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583906.644682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583906.644762:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166400 00000100:00100000:2.0:1784583906.644771:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166400 00000100:00100000:2.0:1784583906.644822:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 353 00000100:00100000:2.0:1784583906.644831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+11:6171:x1871271580166400:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583906.644846:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583906.644860:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e47c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee271 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.644886:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e47c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee271 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.644898:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e47c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee271 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.644907:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784583906.644957:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580166400:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 126us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.644964:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 353 00000100:00100000:1.0:1784583906.646961:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583906.647074:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166528 00000100:00100000:2.0:1784583906.647082:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166528 00000100:00100000:2.0:1784583906.647126:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 354 00000100:00100000:2.0:1784583906.647135:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580166528:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784583906.647259:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580166528:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.647267:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 354 00000100:00100000:3.0:1784583906.654681:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583906.654773:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166656 00000100:00100000:1.0:1784583906.654782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166656 00000100:00100000:1.0:1784583906.654840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 355 00000100:00100000:1.0:1784583906.654849:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580166656:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.654986:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580166656:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.654994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 355 00000100:00100000:3.0:1784583906.661831:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583906.662053:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166784 00000100:00100000:1.0:1784583906.662063:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166784 00000100:00100000:1.0:1784583906.662114:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 356 00000100:00100000:1.0:1784583906.662123:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:10800:x1871271580166784:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784583906.662248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+12:10800:x1871271580166784:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 126us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.662255:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 356 00000100:00100000:3.0:1784583906.669399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583906.669494:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580166912 00000100:00100000:2.0:1784583906.669514:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580166912 00000100:00100000:2.0:1784583906.669564:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 357 00000100:00100000:2.0:1784583906.669573:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+12:10800:x1871271580166912:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784583906.669696:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+12:10800:x1871271580166912:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 123us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.669705:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 357 00000100:00100000:3.0:1784583906.676560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583906.680849:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167040 00000100:00100000:2.0:1784583906.680862:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167040 00000100:00100000:2.0:1784583906.681080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 358 00000100:00100000:2.0:1784583906.681093:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+12:6171:x1871271580167040:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784583906.681208:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583906.681284:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e47c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee278 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.681314:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e47c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee278 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.681326:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e47c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee278 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583906.681334:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784583906.681611:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580167040:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 520us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583906.682734:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 358 00000100:00100000:3.0:1784583906.690732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583906.690837:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167168 00000100:00100000:1.0:1784583906.690846:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167168 00000100:00100000:1.0:1784583906.690897:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 359 00000100:00100000:1.0:1784583906.690906:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580167168:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784583906.691042:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580167168:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 137us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.691050:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 359 00000100:00100000:3.0:1784583906.692305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583906.692384:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167296 00000100:00100000:0.0:1784583906.692389:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167296 00000100:00100000:0.0:1784583906.692428:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 360 00000100:00100000:0.0:1784583906.692435:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580167296:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784583906.692564:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:6171:x1871271580167296:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 128us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.692571:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 360 00000100:00100000:3.0:1784583906.694356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583906.694692:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167424 00000100:00100000:0.0:1784583906.694699:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167424 00000100:00100000:0.0:1784583906.694731:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 361 00000100:00100000:0.0:1784583906.694738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:10803:x1871271580167424:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784583906.694861:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:10803:x1871271580167424:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 122us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583906.694869:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 361 00000100:00100000:3.0:1784583906.699013:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583906.699126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167552 00000100:00100000:1.0:1784583906.699136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167552 00000100:00100000:1.0:1784583906.699184:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 362 00000100:00100000:1.0:1784583906.699192:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:10803:x1871271580167552:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784583906.699325:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:10803:x1871271580167552:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583906.699333:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 362 00000040:00080000:2.0:1784583907.118406:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784583907.182338:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784583907.501679:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583908.526626:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583909.040710:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583909.040808:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599123584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583909.040878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583909.041075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123584 00000100:00100000:2.0:1784583909.041095:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123584 00000100:00100000:2.0:1784583909.041180:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784583909.041189:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599123584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583909.041221:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583909.041272:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599123584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583909.041279:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784583909.041342:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599123584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583909.554704:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583910.485135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583910.485176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583910.485206:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583910.486096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167680 00000100:00100000:2.0:1784583910.486116:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167680 00000100:00100000:2.0:1784583910.486173:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 363 00000100:00100000:2.0:1784583910.486182:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580167680:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583910.486248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580167680:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 67us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583910.486257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 363 00000100:00100000:0.0:1784583910.487359:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167936 00000100:00100000:0.0:1784583910.487368:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167936 00000100:00100000:0.0:1784583910.487416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168192 00000100:00100000:0.0:1784583910.487433:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168192 00000100:00100000:0.0:1784583910.487464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:0.0:1784583910.487522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580167936:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583910.487575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580167936:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 57us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.487599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:0.0:1784583910.487617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00100000:0.0:1784583910.487623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580168192:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583910.487648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580168192:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.487654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00080000:2.0:1784583910.488694:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583910.488702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583910.499830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583910.499878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583910.499916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583910.500294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580167808 00000100:00100000:0.0:1784583910.500307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580167808 00000100:00100000:0.0:1784583910.500389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168320 00000100:00100000:0.0:1784583910.500392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168320 00000100:00100000:0.0:1784583910.500415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:0.0:1784583910.500437:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580167808:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583910.500532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580167808:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 109us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.500540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:0.0:1784583910.500555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:0.0:1784583910.500560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580168320:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583910.500582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580168320:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.500588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00080000:3.0:1784583910.500700:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583910.500705:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583910.500788:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168064 00000100:00100000:1.0:1784583910.500793:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168064 00000100:00100000:1.0:1784583910.500845:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:1.0:1784583910.500854:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168064:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583910.500885:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168064:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583910.500892:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00080000:3.0:1784583910.500964:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583910.573661:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583910.573684:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599123712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583910.573750:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583910.573827:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123712 00000100:00100000:3.0:1784583910.573834:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123712 00000100:00100000:3.0:1784583910.573888:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784583910.573909:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599123712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583910.573950:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583910.573991:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599123712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583910.573999:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1784583910.574022:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583910.574053:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599123712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583910.575058:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599123840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583910.575102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583910.575149:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123840 00000100:00100000:2.0:1784583910.575154:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123840 00000100:00100000:2.0:1784583910.575190:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784583910.575197:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599123840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583910.575212:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583910.575245:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599123840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583910.575252:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784583910.575287:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599123840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784583910.575319:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583910.575623:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583910.575633:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599123968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583910.575661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583910.575688:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599123968 00000100:00100000:3.0:1784583910.575691:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599123968 00000100:00100000:3.0:1784583910.575719:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784583910.575726:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599123968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583910.575742:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583910.575837:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599123968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583910.575844:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1784583910.575876:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437681880 x1871271599123968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583910.575891:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599123968:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784583910.575909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784583910.575919:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583910.577529:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599124096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583910.577578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583910.577698:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599124224:0@lo:400:kworker.0 00000100:00100000:1.0:1784583910.577726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583910.577748:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599124736:0@lo:400:kworker.0 00000100:00100000:1.0:1784583910.577777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583910.577796:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599125248:0@lo:400:kworker.0 00000100:00100000:1.0:1784583910.577818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583910.577836:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784583910.577841:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599124352:0@lo:400:kworker.0 00000100:00100000:1.0:1784583910.577861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583910.577961:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124224 00000100:00100000:0.0:1784583910.577969:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124224 00000100:00100000:0.0:1784583910.578011:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784583910.578020:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599124224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578081:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599124224:12345-0@lo:400:kworker.0 Request processed in 62us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.578089:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784583910.578207:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599124608:0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578237:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599124480:0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583910.578278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599124992:0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578305:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124736 00000100:00100000:0.0:1784583910.578308:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124736 00000100:00100000:0.0:1784583910.578638:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124480 00000100:00100000:0.0:1784583910.578642:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124480 00000100:00100000:0.0:1784583910.578655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784583910.578661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599124736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578698:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599124736:12345-0@lo:400:kworker.0 Request processed in 37us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.578703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784583910.578714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784583910.578718:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599124480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.578746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599124480:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.578751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784583910.578769:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124096 00000100:00100000:0.0:1784583910.578773:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124096 00000100:00100000:0.0:1784583910.578800:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784583910.578805:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599124096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784583910.578828:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583910.578860:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599124096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.578866:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1784583910.579017:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1784583910.579180:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1784583910.585313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583910.585566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125248 00000100:00100000:0.0:1784583910.585575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125248 00000100:00100000:0.0:1784583910.585636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124352 00000100:00100000:0.0:1784583910.585640:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124352 00000100:00100000:0.0:1784583910.585661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784583910.585670:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599125248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.585745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599125248:12345-0@lo:400:kworker.0 Request processed in 76us (7924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.585754:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784583910.585770:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784583910.585776:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599124352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.585805:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599124352:12345-0@lo:400:kworker.0 Request processed in 29us (7942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.585812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784583910.585866:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599124352:0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.585877:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599124864:0@lo:400:kworker.0 00000100:00080000:2.0:1784583910.585972:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583910.591988:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599124480:0@lo:400:kworker.0 00000100:00100000:2.0:1784583910.592205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583910.599139:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599124224:0@lo:400:kworker.0 00000100:00100000:2.0:1784583910.599156:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599124736:0@lo:400:kworker.0 00010000:00080000:2.0:1784583910.599171:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303aac000 x1871271599125248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583910.599182:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599125248:0@lo:400:kworker.0 00000100:00100000:3.0:1784583910.599343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583910.602933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124992 00000100:00100000:0.0:1784583910.602948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124992 00000100:00100000:0.0:1784583910.603039:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124864 00000100:00100000:0.0:1784583910.603043:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124864 00000100:00100000:0.0:1784583910.603080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784583910.603090:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599124992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.603195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599124992:12345-0@lo:400:kworker.0 Request processed in 106us (17889us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.603203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784583910.603220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784583910.603227:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599124864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.603263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599124864:12345-0@lo:400:kworker.0 Request processed in 37us (11058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.603270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1784583910.603297:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583910.603301:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583910.603335:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599124864:0@lo:400:kworker.0 00010000:00080000:0.0:1784583910.603390:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c4380 x1871271599124992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583910.603402:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599124992:0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.605242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599124608 00000100:00100000:0.0:1784583910.605255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599124608 00000100:00100000:0.0:1784583910.605315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784583910.605324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599124608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583910.605390:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599124608:12345-0@lo:400:kworker.0 Request processed in 67us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583910.605397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784583910.605509:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599124608:0@lo:400:kworker.0 00000100:00100000:2.0:1784583910.605521:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599125120:0@lo:400:kworker.0 00000100:00100000:2.0:1784583910.605560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784583910.605594:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c7480 x1871271599124096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583910.605612:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599124096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583910.605713:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125120 00000100:00100000:1.0:1784583910.605718:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125120 00000100:00100000:1.0:1784583910.605783:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784583910.605790:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599125120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583910.605832:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599125120:12345-0@lo:400:kworker.0 Request processed in 43us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583910.605838:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784583910.605865:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599125120:0@lo:400:kworker.0 00000100:00080000:0.0:1784583910.605933:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583911.086275:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599125376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583911.086356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583911.086598:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125376 00000100:00100000:1.0:1784583911.086606:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125376 00000100:00100000:1.0:1784583911.086646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784583911.086655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599125376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784583911.086690:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784583911.087950:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599125376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1290us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583911.087962:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784583911.088115:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599125376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583911.597896:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583912.621758:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583913.645671:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583914.157721:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599125504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583914.157810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583914.157991:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125504 00000100:00100000:1.0:1784583914.157999:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125504 00000100:00100000:1.0:1784583914.158070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784583914.158079:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599125504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583914.158114:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583914.158940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599125504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 858us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583914.158950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784583914.159131:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599125504:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583914.670162:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583915.609709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609789:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583915.609890:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168832 00000100:00100000:3.0:1784583915.609899:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168832 00000100:00100000:0.0:1784583915.609932:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168576 00000100:00100000:0.0:1784583915.609938:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168576 00000100:00100000:3.0:1784583915.609955:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:3.0:1784583915.609967:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168832:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583915.609968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168704 00000100:00100000:0.0:1784583915.609973:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168704 00000100:00100000:0.0:1784583915.609989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169088 00000100:00100000:0.0:1784583915.609992:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169088 00000100:00100000:0.0:1784583915.610008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168960 00000100:00100000:0.0:1784583915.610011:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168960 00000100:00100000:0.0:1784583915.610027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:0.0:1784583915.610035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583915.610041:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168832:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583915.610049:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:0.0:1784583915.610075:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.610084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:3.0:1784583915.610091:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:3.0:1784583915.610101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168704:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583915.610104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 225 00000100:00100000:0.0:1784583915.610116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169088:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583915.610142:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580168704:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583915.610151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:0.0:1784583915.610151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169088:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.610163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 225 00000100:00100000:0.0:1784583915.610179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:0.0:1784583915.610186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580168960:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583915.610212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580168960:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.610220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00080000:0.0:1784583915.610254:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583915.610258:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583915.610261:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583915.610793:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580168448 00000100:00100000:1.0:1784583915.610799:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580168448 00000100:00100000:1.0:1784583915.610841:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 365 00000100:00100000:1.0:1784583915.610849:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580168448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583915.610906:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580168448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 57us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583915.610912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 365 00000100:00100000:0.0:1784583915.693662:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583915.693744:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583915.693828:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125632 00000100:00100000:0.0:1784583915.693835:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125632 00010000:00010000:2.0:1784583915.697956:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583915.697973:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599126016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583915.698035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583915.698138:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599125760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583915.698194:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599125888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583915.699492:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583915.699503:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599126144:0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.699540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784583915.702997:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583915.703095:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126016 00000100:00100000:0.0:1784583915.703105:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126016 00000100:00100000:0.0:1784583915.704370:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784583915.704380:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599125632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583915.704428:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583915.704511:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599125632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (10768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.704518:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784583915.704533:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784583915.704538:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599126016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784583915.704547:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583915.704572:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599126016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.704578:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784583915.704619:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599126016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583915.704652:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126144 00000100:00100000:0.0:1784583915.704654:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:2.0:1784583915.704660:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126144 00000004:00080000:0.0:1784583915.704660:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b42f7a1f80, transno 4294967301 00000100:00100000:0.0:1784583915.704675:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583915.704725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784583915.704734:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599126144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.704787:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599126144:12345-0@lo:400:kworker.0 Request processed in 54us (5244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.704795:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1784583915.704801:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599126144:0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.704851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583915.704901:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784583915.704911:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599126272:0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.704939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583915.704962:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125888 00000100:00100000:2.0:1784583915.704966:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125888 00000100:00100000:2.0:1784583915.704992:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784583915.704998:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599125888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583915.705015:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583915.705046:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599125888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.705053:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1784583915.705078:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303853100 x1871271599125888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583915.705093:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599125888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583915.705119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583915.705146:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599125760 00000100:00100000:2.0:1784583915.705149:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599125760 00000100:00100000:2.0:1784583915.705167:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784583915.705174:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599125760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583915.705184:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784583915.705216:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583915.705222:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583915.705227:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599125760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.705234:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1784583915.705265:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437681c00 x1871271599125760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583915.705280:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599125760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583915.705307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126272 00000100:00100000:2.0:1784583915.705311:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126272 00000100:00100000:2.0:1784583915.705632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784583915.705639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.705679:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599126272:12345-0@lo:400:kworker.0 Request processed in 40us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.705685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784583915.705696:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599126272:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.710913:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599126656:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.710980:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583915.711031:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599127168:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.711057:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583915.711210:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599126400:0@lo:400:kworker.0 00000100:00100000:0.0:1784583915.711239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583915.711256:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599126912:0@lo:400:kworker.0 00000100:00100000:0.0:1784583915.711299:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126656 00000100:00100000:0.0:1784583915.711305:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126656 00000100:00100000:0.0:1784583915.711344:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126400 00000100:00100000:0.0:1784583915.711347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126400 00000100:00100000:0.0:1784583915.711362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784583915.711370:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599126656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583915.711425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599126656:12345-0@lo:400:kworker.0 Request processed in 55us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.711432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784583915.711448:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784583915.711454:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583915.711509:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599126400:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583915.711515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784583915.711730:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599126656:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.711754:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784583915.711761:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599126528:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.711786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583915.714519:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599126784:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.716575:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599127040:0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.716632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583915.724118:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127168 00000100:00100000:0.0:1784583915.724131:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127168 00000100:00080000:1.0:1784583915.724461:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583915.728864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126528 00000100:00100000:2.0:1784583915.728878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126528 00000100:00100000:2.0:1784583915.728926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127040 00000100:00100000:2.0:1784583915.728930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127040 00000100:00100000:2.0:1784583915.728958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784583915.728967:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599127168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.729077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599127168:12345-0@lo:400:kworker.0 Request processed in 101us (18007us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.729084:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784583915.729111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784583915.729117:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599126528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.729145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599126528:12345-0@lo:400:kworker.0 Request processed in 29us (17358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.729156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784583915.729852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784583915.729864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599127040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.729905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599127040:12345-0@lo:400:kworker.0 Request processed in 44us (13272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583915.729911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784583915.729957:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599126528:0@lo:400:kworker.0 00000100:00100000:2.0:1784583915.729970:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599127040:0@lo:400:kworker.0 00010000:00080000:2.0:1784583915.729985:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437699f80 x1871271599127168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583915.729996:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599127168:0@lo:400:kworker.0 00000100:00080000:3.0:1784583915.730855:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583915.730928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583915.730996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583915.731045:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599126400:0@lo:400:kworker.0 00000100:00100000:1.0:1784583915.731083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126784 00000100:00100000:1.0:1784583915.731098:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126784 00000100:00100000:1.0:1784583915.731144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599126912 00000100:00100000:1.0:1784583915.731147:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599126912 00000100:00100000:3.0:1784583915.731337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784583915.731347:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599126784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.731419:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599126784:12345-0@lo:400:kworker.0 Request processed in 74us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583915.731427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784583915.731443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784583915.731450:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599126912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583915.731509:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599126912:12345-0@lo:400:kworker.0 Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583915.731514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1784583915.731629:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583915.731632:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583915.731652:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599126784:0@lo:400:kworker.0 00010000:00080000:1.0:1784583915.731674:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437699500 x1871271599126912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583915.731683:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599126912:0@lo:400:kworker.0 00000100:00100000:1.0:1784583916.206331:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599127296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583916.206414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583916.206581:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127296 00000100:00100000:0.0:1784583916.206589:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127296 00000100:00100000:0.0:1784583916.206642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784583916.206652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599127296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583916.206708:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583916.206770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599127296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583916.206778:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784583916.207028:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599127296:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583916.717650:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784583917.362990:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784583917.422428:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784583917.743790:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583918.765775:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583919.277777:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599127424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583919.277867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583919.278205:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127424 00000100:00100000:2.0:1784583919.278215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127424 00000100:00100000:2.0:1784583919.278270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784583919.278279:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599127424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583919.278314:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583919.278382:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599127424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583919.278389:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784583919.278441:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599127424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784583919.791817:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583920.727436:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583920.727541:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583920.727579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583920.727739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169472 00000100:00100000:2.0:1784583920.727750:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169472 00000100:00100000:2.0:1784583920.727813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169344 00000100:00100000:2.0:1784583920.727817:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169344 00000100:00100000:2.0:1784583920.727840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:2.0:1784583920.727876:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580169472:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583920.727955:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580169472:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.727963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:2.0:1784583920.727980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:2.0:1784583920.727986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580169344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583920.728025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580169344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.728032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00080000:3.0:1784583920.728721:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583920.728727:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583920.737287:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169216 00000100:00100000:0.0:1784583920.737301:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169216 00000100:00100000:0.0:1784583920.737379:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 367 00000100:00100000:0.0:1784583920.737389:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580169216:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583920.737500:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580169216:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 78us (10039us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.737508:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 367 00000100:00100000:3.0:1784583920.752899:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583920.752945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583920.752983:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583920.753132:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169600 00000100:00100000:2.0:1784583920.753143:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169600 00000100:00100000:2.0:1784583920.753212:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:2.0:1784583920.753224:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2397:x1871271580169600:12345-192.168.203.51@tcp:9:kworker.0 00000100:00080000:3.0:1784583920.753247:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1784583920.753256:0:8805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47b2e 00000100:00080000:2.0:1784583920.753266:0:8805:0:(import.c:65:import_set_state_nolock()) ffff98b30394b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583920.753316:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1784583920.753366:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169728 00000100:00100000:1.0:1784583920.753372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169728 00000100:00100000:1.0:1784583920.753419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169856 00000100:00100000:1.0:1784583920.753423:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169856 00010000:00010000:3.0:1784583920.753445:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784583920.753495:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583920.753500:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583920.753500:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:1.0:1784583920.753511:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169728:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583920.753531:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+2:2397:x1871271580169600:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 297us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.753542:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1784583920.753551:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169728:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.753560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:1.0:1784583920.753579:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:1.0:1784583920.753586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169856:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583920.753610:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580169856:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.753617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:3.0:1784583920.813784:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599127936:0@lo:400:kworker.0 00000100:00100000:3.0:1784583920.813855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.814020:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599127552:0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.814177:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599127808:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.814266:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599127680:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.821106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.821184:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599128064:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.821238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.821261:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599128576:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.821286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.822521:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599129088:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.822569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.822667:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128576 00000100:00100000:1.0:1784583920.822673:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128576 00000100:00100000:1.0:1784583920.823233:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129088 00000100:00100000:1.0:1784583920.823238:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129088 00000100:00100000:1.0:1784583920.823263:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784583920.823272:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823335:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599128576:12345-0@lo:400:kworker.0 Request processed in 64us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.823367:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784583920.823382:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784583920.823388:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599129088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823418:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599129088:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.823423:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1784583920.823446:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583920.823449:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583920.823460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128064 00000100:00100000:1.0:1784583920.823464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128064 00000100:00100000:1.0:1784583920.823508:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784583920.823514:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599128064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823546:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599128064:12345-0@lo:400:kworker.0 Request processed in 32us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.823551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784583920.823571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127936 00000100:00100000:1.0:1784583920.823574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127936 00000100:00100000:1.0:1784583920.823599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784583920.823606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599127936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599127936:12345-0@lo:400:kworker.0 Request processed in 32us (9782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.823643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784583920.823695:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599128064:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823813:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599128576:0@lo:400:kworker.0 00010000:00080000:1.0:1784583920.823825:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766f100 x1871271599129088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583920.823844:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599129088:0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.823947:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127552 00000100:00100000:1.0:1784583920.823952:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127552 00000100:00100000:1.0:1784583920.823985:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784583920.823992:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599127552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.824028:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599127552:12345-0@lo:400:kworker.0 Request processed in 36us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.824034:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784583920.824087:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599127552:0@lo:400:kworker.0 00010000:00010000:1.0:1784583920.824186:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583920.824219:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599129600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583920.824245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.824280:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129600 00000100:00100000:1.0:1784583920.824284:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129600 00000100:00100000:1.0:1784583920.824308:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784583920.824314:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599129600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583920.824334:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583920.824381:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599129600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.824388:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1784583920.824408:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437698700 x1871271599129600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583920.824420:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599129600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583920.824525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583920.824554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127808 00000100:00100000:0.0:1784583920.824557:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127808 00000100:00100000:0.0:1784583920.824584:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784583920.824591:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599127808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.824626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599127808:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.824633:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784583920.824662:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599127808:0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.824670:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599128320:0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.824694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583920.825053:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599128832:0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.825069:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128320 00000100:00100000:0.0:1784583920.825081:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128320 00000100:00100000:0.0:1784583920.825121:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784583920.825128:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599128320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.825151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583920.825164:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599128320:12345-0@lo:400:kworker.0 Request processed in 36us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.825172:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784583920.825183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128832 00000100:00100000:1.0:1784583920.825188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128832 00000100:00080000:0.0:1784583920.825194:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583920.825226:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599129344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583920.825253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583920.825280:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129344 00000100:00100000:0.0:1784583920.825284:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129344 00000100:00100000:1.0:1784583920.825291:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784583920.825316:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784583920.825324:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599129344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784583920.825336:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583920.825374:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599129344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.825380:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1784583920.825393:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583920.825396:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784583920.825414:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303853100 x1871271599129344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583920.825429:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599129344:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784583920.825439:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437698e00 x1871271599128320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583920.825447:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599128320:0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.825460:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583920.825497:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599129472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583920.825521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583920.825543:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129472 00000100:00100000:0.0:1784583920.825547:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129472 00000100:00100000:1.0:1784583920.825554:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599128832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583920.825578:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784583920.825588:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599129472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583920.825596:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599128832:12345-0@lo:400:kworker.0 Request processed in 296us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.825604:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00002000:00000024:0.0:1784583920.825606:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784583920.825635:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583920.825644:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599129472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.825652:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784583920.825667:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599129472:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1784583920.826507:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766c700 x1871271599128832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583920.826519:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599128832:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583920.828520:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599128192:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583920.828588:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599128704:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583920.828661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599127680 00000100:00100000:2.0:1784583920.828667:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599127680 00000100:00100000:2.0:1784583920.828709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128192 00000100:00100000:2.0:1784583920.828723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128192 00000100:00100000:2.0:1784583920.828747:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128704 00000100:00100000:2.0:1784583920.828750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128704 00000100:00100000:2.0:1784583920.828766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784583920.828774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599127680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599127680:12345-0@lo:400:kworker.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.828828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784583920.828844:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784583920.828850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599128192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599128192:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.828882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784583920.828893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784583920.828899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599128704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828924:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599128704:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583920.828930:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1784583920.828948:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583920.828973:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599128704:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.828982:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599129216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583920.829141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583920.829191:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599127680:0@lo:400:kworker.0 00000100:00100000:2.0:1784583920.829202:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599128192:0@lo:400:kworker.0 00000100:00100000:3.0:1784583920.829460:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599127936:0@lo:400:kworker.0 00000100:00100000:3.0:1784583920.829489:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599128448:0@lo:400:kworker.0 00000100:00100000:3.0:1784583920.829520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583920.829549:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599128960:0@lo:400:kworker.0 00000100:00100000:3.0:1784583920.829571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583920.831661:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128448 00000100:00100000:0.0:1784583920.831696:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129216 00000100:00100000:0.0:1784583920.831705:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129216 00000100:00100000:0.0:1784583920.831782:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784583920.831792:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599129216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583920.831819:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583920.831905:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599129216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583920.831914:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784583920.831959:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599129216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583920.832279:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128448 00000100:00100000:1.0:1784583920.832429:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599128960 00000100:00100000:1.0:1784583920.832434:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599128960 00000100:00100000:1.0:1784583920.832614:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784583920.832623:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599128960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.832680:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599128960:12345-0@lo:400:kworker.0 Request processed in 59us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.832695:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784583920.832725:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784583920.832732:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599128448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583920.832760:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599128448:12345-0@lo:400:kworker.0 Request processed in 29us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583920.832776:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784583920.832851:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599128448:0@lo:400:kworker.0 00010000:00080000:0.0:1784583920.832865:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766c000 x1871271599128960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583920.832884:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599128960:0@lo:400:kworker.0 00000100:00100000:1.0:1784583921.325793:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784583921.325818:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599129728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583921.325896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583921.326065:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129728 00000100:00100000:0.0:1784583921.326073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129728 00000100:00100000:0.0:1784583921.326127:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784583921.326136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599129728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784583921.326182:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784583921.326234:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599129728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583921.326242:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784583921.326614:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599129728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583921.837827:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583922.867222:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583923.885670:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583924.397930:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583924.397956:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599129856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583924.398027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583924.398740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129856 00000100:00100000:2.0:1784583924.398749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129856 00000100:00100000:2.0:1784583924.398818:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784583924.399955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599129856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583924.399993:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583924.400076:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599129856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583924.400162:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599129856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583924.402729:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:1.0:1784583924.909778:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583925.847049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583925.847352:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580169984 00000100:00100000:0.0:1784583925.847363:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580169984 00000100:00100000:0.0:1784583925.847428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 369 00000100:00100000:0.0:1784583925.847439:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580169984:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583925.847548:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580169984:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 111us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583925.847556:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 369 00000100:00100000:3.0:1784583925.851102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583925.851155:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583925.851187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583925.851233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170112 00000100:00100000:1.0:1784583925.851242:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170112 00000100:00100000:1.0:1784583925.851299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170240 00000100:00100000:1.0:1784583925.851302:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170240 00000100:00100000:1.0:1784583925.851315:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170368 00000100:00100000:1.0:1784583925.851317:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170368 00000100:00100000:0.0:1784583925.851359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:0.0:1784583925.851373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580170112:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583925.851454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580170112:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 86us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583925.851461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:0.0:1784583925.851513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:1.0:1784583925.851523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:0.0:1784583925.851524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580170240:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583925.851538:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580170368:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583925.851556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580170240:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583925.851563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:1.0:1784583925.851578:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580170368:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 43us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.851586:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:3.0:1784583925.852120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583925.852194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170496 00000100:00100000:2.0:1784583925.852200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170496 00000100:00080000:1.0:1784583925.852223:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583925.852229:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583925.852251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:2.0:1784583925.852259:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580170496:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583925.852291:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580170496:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.852298:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:1.0:1784583925.933679:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599130368:0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.933792:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599130240:0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.933826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.933868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583925.933878:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599130752:0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.933902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.933911:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599130880:0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.933931:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599131264:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.933943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.933975:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599131392:0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.933978:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130240 00000100:00100000:3.0:1784583925.933985:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130240 00000100:00100000:1.0:1784583925.934014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583925.934153:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583925.934173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130368 00000100:00100000:0.0:1784583925.934177:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130368 00000100:00100000:0.0:1784583925.934205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784583925.934213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599130368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583925.934259:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599130368:12345-0@lo:400:kworker.0 Request processed in 47us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583925.934266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784583925.934356:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599129984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583925.934388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.934408:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599130496:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.934437:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599129984 00000100:00100000:2.0:1784583925.934440:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599129984 00000100:00100000:2.0:1784583925.934496:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583925.934503:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599129984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583925.934533:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583925.934569:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599129984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.934576:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1784583925.934593:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583925.934608:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599130112:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.934636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.934672:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599130624:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.934694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.934710:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599131136:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.934732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.934747:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599131648:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.935584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.935650:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130112 00000100:00100000:2.0:1784583925.935657:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130112 00000100:00100000:2.0:1784583925.935691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1784583925.935699:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599130112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.935743:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599130112:12345-0@lo:400:kworker.0 Request processed in 45us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.935749:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1784583925.935851:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130624 00000100:00100000:2.0:1784583925.935855:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130624 00000100:00100000:2.0:1784583925.935879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784583925.935885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599130624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.935919:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599130624:12345-0@lo:400:kworker.0 Request processed in 35us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.935935:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784583925.935972:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599130112:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.935983:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599130624:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.937707:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599130368:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.937738:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599131904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583925.938593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.938865:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131136 00000100:00100000:1.0:1784583925.938874:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131136 00000100:00100000:1.0:1784583925.938929:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131648 00000100:00100000:1.0:1784583925.938932:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131648 00000100:00100000:1.0:1784583925.938956:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784583925.938965:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599131136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.939282:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599131136:12345-0@lo:400:kworker.0 Request processed in 317us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.939290:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784583925.939308:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784583925.939316:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599131648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.939361:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599131648:12345-0@lo:400:kworker.0 Request processed in 46us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.939367:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1784583925.939389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583925.939393:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583925.939404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583925.939490:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130752 00000100:00100000:3.0:1784583925.939496:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130752 00000100:00100000:3.0:1784583925.939533:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130880 00000100:00100000:3.0:1784583925.939537:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130880 00000100:00100000:3.0:1784583925.939551:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131392 00000100:00100000:3.0:1784583925.939554:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131392 00000100:00100000:3.0:1784583925.939572:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784583925.939579:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599130240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.939619:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599130240:12345-0@lo:400:kworker.0 Request processed in 41us (5793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583925.939626:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784583925.939641:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784583925.939648:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599130752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.939690:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599130752:12345-0@lo:400:kworker.0 Request processed in 42us (5786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583925.939696:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784583925.939709:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1784583925.939725:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599130880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.939904:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599130880:12345-0@lo:400:kworker.0 Request processed in 180us (5961us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583925.939911:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1784583925.939925:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784583925.939931:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599131392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.939960:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599131392:12345-0@lo:400:kworker.0 Request processed in 30us (5946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583925.940043:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784583925.940146:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599131136:0@lo:400:kworker.0 00010000:00080000:3.0:1784583925.940164:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b409219880 x1871271599131648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583925.940174:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599131648:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.942081:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599131776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583925.942146:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.942201:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599130240:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.942218:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599130752:0@lo:400:kworker.0 00000100:00080000:1.0:1784583925.942245:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583925.942250:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583925.942261:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131904 00000100:00100000:1.0:1784583925.942267:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131904 00000100:00100000:1.0:1784583925.942314:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131776 00000100:00100000:1.0:1784583925.942317:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131776 00000100:00100000:1.0:1784583925.942346:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784583925.942366:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599131904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784583925.942388:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583925.942426:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599131904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.942433:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784583925.942449:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784583925.942455:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599131776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583925.942503:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583925.942540:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599131776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.942546:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784583925.942573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583925.944361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131264 00000100:00100000:2.0:1784583925.944372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131264 00000100:00100000:2.0:1784583925.944442:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784583925.944452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599131264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.944537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599131264:12345-0@lo:400:kworker.0 Request processed in 86us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.944545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1784583925.944581:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599131264:0@lo:400:kworker.0 00010000:00080000:0.0:1784583925.944599:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b409219500 x1871271599131776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583925.944623:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599131776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583925.944626:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599131904:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1784583925.944647:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766c380 x1871271599130880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583925.944658:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599130880:0@lo:400:kworker.0 00000100:00080000:0.0:1784583925.944662:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784583925.944673:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766f100 x1871271599131392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583925.944681:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599131392:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.944799:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599131008:0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.944831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.944849:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599131520:0@lo:400:kworker.0 00000100:00100000:0.0:1784583925.944862:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131008 00000100:00100000:0.0:1784583925.944867:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131008 00000100:00100000:1.0:1784583925.944872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583925.944892:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599132032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583925.944898:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599131520 00000100:00100000:0.0:1784583925.944902:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599131520 00000100:00100000:1.0:1784583925.944916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583925.944937:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784583925.944946:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599131008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583925.944956:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599129984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583925.944981:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784583925.944989:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599131520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.945141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599130496 00000100:00100000:2.0:1784583925.945146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599130496 00000100:00100000:2.0:1784583925.945173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784583925.945179:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599130496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583925.945302:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132032 00000100:00100000:3.0:1784583925.945312:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132032 00000100:00100000:3.0:1784583925.945347:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784583925.945353:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599132032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583925.945366:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583925.945522:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599131008:12345-0@lo:400:kworker.0 Request processed in 577us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583925.945530:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784583925.945548:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583925.945571:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599131520:12345-0@lo:400:kworker.0 Request processed in 581us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583925.945579:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784583925.945591:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599131008:0@lo:400:kworker.0 00010000:00080000:0.0:1784583925.945609:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43c8ee680 x1871271599131520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583925.945632:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599131520:0@lo:400:kworker.0 00000100:00100000:2.0:1784583925.945688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599130496:12345-0@lo:400:kworker.0 Request processed in 507us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583925.945703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784583925.945761:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599132032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 407us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583925.945768:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784583925.945917:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599130496:0@lo:400:kworker.0 00010000:00080000:0.0:1784583925.945928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b3040d2680 x1871271599132032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583925.945940:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599132032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583926.445656:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599132160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583926.445734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583926.445901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132160 00000100:00100000:2.0:1784583926.445909:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132160 00000100:00100000:2.0:1784583926.445965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784583926.445975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599132160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583926.446009:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583926.446060:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599132160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583926.446067:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784583926.446846:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599132160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583926.957830:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784583926.962282:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:0.0:1784583926.962290:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b30394d000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583926.962365:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30394d000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-OST0000 00000020:00000080:3.0:1784583926.962414:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30394b800 for lustre-OST0000 00000040:00080000:2.0:1784583927.606326:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784583927.668547:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784583927.981842:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583929.006065:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583929.523154:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583929.525648:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599132288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583929.525869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583929.526185:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132288 00000100:00100000:3.0:1784583929.526193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132288 00000100:00100000:3.0:1784583929.526371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784583929.526382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599132288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583929.526433:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583929.526508:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599132288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583929.526517:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784583929.526553:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599132288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784583930.030213:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583930.972407:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583930.972505:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170624 00000100:00100000:0.0:1784583930.972514:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170624 00000100:00100000:0.0:1784583930.972575:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 371 00000100:00100000:0.0:1784583930.972586:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580170624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583930.972779:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580170624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 188us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583930.972788:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 371 00000100:00100000:3.0:1784583930.973594:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583930.973757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170752 00000100:00100000:1.0:1784583930.973763:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170752 00000100:00100000:1.0:1784583930.973831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:1.0:1784583930.973839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580170752:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583930.973887:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580170752:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583930.973894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00080000:1.0:1784583930.973926:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583930.987892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583930.987939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583930.987975:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583930.988006:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171008 00000100:00100000:3.0:1784583930.988015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171008 00000100:00100000:3.0:1784583930.988071:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580170880 00000100:00100000:3.0:1784583930.988075:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580170880 00000100:00100000:3.0:1784583930.988088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171136 00000100:00100000:3.0:1784583930.988090:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171136 00000100:00100000:3.0:1784583930.988105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:3.0:1784583930.988124:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580171008:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583930.988198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580171008:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 85us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583930.988206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:3.0:1784583930.988222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00100000:3.0:1784583930.988227:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580170880:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583930.988250:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580170880:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583930.988266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00100000:3.0:1784583930.988278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00100000:3.0:1784583930.988359:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580171136:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583930.988456:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580171136:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 171us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583930.988463:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00080000:3.0:1784583930.988511:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583930.988591:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583931.053702:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599132416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583931.053778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583931.053887:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132416 00000100:00100000:1.0:1784583931.053894:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132416 00000100:00100000:1.0:1784583931.053953:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784583931.053962:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599132416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583931.053991:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583931.054038:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599132416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583931.054047:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1784583931.054103:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583931.054138:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599132416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583931.054375:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599132544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583931.054407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.054454:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132544 00000100:00100000:0.0:1784583931.054459:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132544 00000100:00100000:0.0:1784583931.054512:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784583931.054520:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599132544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583931.054533:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583931.054565:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599132544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.054571:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:0.0:1784583931.054627:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583931.054649:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599132544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583931.054746:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784583931.054756:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599132672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583931.054783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784583931.054805:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583931.054813:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132672 00000100:00100000:2.0:1784583931.054817:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132672 00000100:00100000:2.0:1784583931.054844:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784583931.054851:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599132672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583931.054868:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583931.054901:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599132672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583931.054916:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1784583931.054935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784583931.054954:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7a6a00 x1871271599132672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583931.054969:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599132672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583931.055108:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599132800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583931.055133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.056394:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599133184:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.056487:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599133696:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.056539:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784583931.056545:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599133312:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.056583:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599133824:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.056637:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133184 00000100:00100000:0.0:1784583931.056643:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133184 00000100:00100000:0.0:1784583931.056677:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784583931.056684:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599133184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056728:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599133184:12345-0@lo:400:kworker.0 Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.056734:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784583931.056764:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133696 00000100:00100000:0.0:1784583931.056768:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133696 00000100:00100000:0.0:1784583931.056798:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133312 00000100:00100000:0.0:1784583931.056800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133312 00000100:00100000:0.0:1784583931.056810:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133824 00000100:00100000:0.0:1784583931.056812:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133824 00000100:00100000:0.0:1784583931.056825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784583931.056832:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056862:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599133696:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.056868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784583931.056880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784583931.056887:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599133312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056912:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599133312:12345-0@lo:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.056917:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784583931.056926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784583931.056932:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599133824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.056957:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599133824:12345-0@lo:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.056962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784583931.056990:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599133056:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.057013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.057027:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599133568:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.057044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.057060:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784583931.057066:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599132928:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.057099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.057117:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599133440:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.057141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.057155:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599133952:0@lo:400:kworker.0 00000100:00100000:1.0:1784583931.057274:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132800 00000100:00100000:1.0:1784583931.057279:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132800 00000100:00100000:1.0:1784583931.057320:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784583931.057327:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599132800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583931.057344:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583931.057377:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599132800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583931.057384:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784583931.058104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133440 00000100:00100000:2.0:1784583931.058112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133440 00000100:00100000:2.0:1784583931.058139:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784583931.058146:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599133440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583931.058207:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599133440:12345-0@lo:400:kworker.0 Request processed in 62us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583931.058214:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784583931.058236:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599132928 00000100:00100000:2.0:1784583931.058239:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599132928 00000100:00100000:2.0:1784583931.058266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1784583931.058272:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599132928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583931.058311:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599132928:12345-0@lo:400:kworker.0 Request processed in 40us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583931.058317:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:2.0:1784583931.058342:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583931.058347:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583931.058349:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784583931.058377:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4332c4a80 x1871271599132800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784583947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583931.058411:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4332c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599132800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583931.059140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583931.059191:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599132928:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059203:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599133440:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059227:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133056 00000100:00100000:0.0:1784583931.059232:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133056 00000100:00100000:0.0:1784583931.059270:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133568 00000100:00100000:0.0:1784583931.059273:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133568 00000100:00100000:0.0:1784583931.059303:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599133952 00000100:00100000:0.0:1784583931.059306:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599133952 00000100:00100000:0.0:1784583931.059321:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784583931.059326:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599133056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059369:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599133056:12345-0@lo:400:kworker.0 Request processed in 42us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.059376:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784583931.059390:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784583931.059395:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059420:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599133568:12345-0@lo:400:kworker.0 Request processed in 26us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.059425:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784583931.059434:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784583931.059439:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059504:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599133952:12345-0@lo:400:kworker.0 Request processed in 64us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583931.059510:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784583931.059550:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599133312:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059563:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599133824:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059573:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599133184:0@lo:400:kworker.0 00010000:00080000:0.0:1784583931.059587:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab1880 x1871271599133696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583931.059596:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599133696:0@lo:400:kworker.0 00010000:00080000:0.0:1784583931.059624:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303ab1180 x1871271599133952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583931.059632:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599133952:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059869:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599133056:0@lo:400:kworker.0 00000100:00100000:0.0:1784583931.059883:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599133568:0@lo:400:kworker.0 00000100:00080000:2.0:1784583931.059962:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583931.059966:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583931.565937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583931.565972:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599134080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583931.566054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583931.566207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599134080 00000100:00100000:2.0:1784583931.566226:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599134080 00000100:00100000:2.0:1784583931.566300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784583931.566311:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599134080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583931.566346:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784583931.566401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599134080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583931.566409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784583931.566828:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599134080:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1784583931.754941:0:14053:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:45:30 (1784583930) 00010000:00010000:0.0:1784583932.077715:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583933.102369:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583933.178900:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583933.179071:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171264 00000100:00100000:1.0:1784583933.179081:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171264 00000100:00100000:1.0:1784583933.179164:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1784583933.179175:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:11093:x1871271580171264:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583933.179195:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583933.179218:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf400/0xdab2421a42e47c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee27f expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179291:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179307:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179321:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583933.179381:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784583933.179385:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583933.179421:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179445:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf400/0xdab2421a42e47c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee27f expref: 7 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179464:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee27f expref: 6 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583933.179529:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397af00) 00010000:00010000:1.0:1784583933.179532:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784583933.179535:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf800, rc 0) 00000100:00100000:1.0:1784583933.179589:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:11093:x1871271580171264:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 417us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583933.179596:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00080000:2.0:1784583933.179666:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583933.190679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583933.190953:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171392 00000100:00100000:3.0:1784583933.190963:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171392 00000100:00100000:3.0:1784583933.191027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784583933.191039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:11094:x1871271580171392:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583933.191124:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583933.191148:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee286 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191215:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191229:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191242:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191257:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191292:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191301:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191428:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191437:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191445:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583933.191514:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784583933.191518:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583933.191541:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191552:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191558:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191566:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191572:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583933.191575:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191590:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191603:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397af00) 00010000:00010000:3.0:1784583933.191606:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583933.191611:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.191618:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192197:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192204:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192209:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192214:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583933.192218:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192223:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192231:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98b43e8abb00) 00010000:00010000:3.0:1784583933.192234:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583933.192237:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192254:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192299:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee286 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192314:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee286 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583933.192321:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784583933.192324:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583933.192327:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96000, rc 0) 00000100:00100000:3.0:1784583933.192785:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11094:x1871271580171392:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1740us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583933.192795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784583933.219123:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583933.219405:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171520 00000100:00100000:0.0:1784583933.219431:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171520 00000100:00100000:2.0:1784583933.219530:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784583933.219545:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11094:x1871271580171520:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784583933.219634:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11094:x1871271580171520:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 Request processed in 94us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583933.219642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784583933.221875:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583933.222186:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171776 00000100:00100000:0.0:1784583933.222197:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171776 00000100:00100000:0.0:1784583933.222290:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:0.0:1784583933.222300:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11094:x1871271580171776:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583933.222321:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583933.222342:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47c38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee28d expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222439:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222453:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222462:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222847:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222857:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222866:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222963:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47c4d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222972:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47c4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.222979:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47c4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583933.223000:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784583933.223081:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223089:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223096:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223102:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583933.223106:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223113:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223125:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784583933.223127:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583933.223132:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223138:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223150:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223156:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223174:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223179:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583933.223182:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223187:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223196:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98b301fd1300) 00010000:00010000:0.0:1784583933.223198:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583933.223201:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223206:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47c46 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223884:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47c38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee28d expref: 10 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223904:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47c4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee28d expref: 9 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583933.223912:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:0.0:1784583933.223916:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583933.223918:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1dc00, rc 0) 00000100:00100000:0.0:1784583933.224061:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11094:x1871271580171776:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1761us (2192us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784583933.224078:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784583933.242779:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583933.242861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580171904 00000100:00100000:2.0:1784583933.242871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580171904 00000100:00100000:2.0:1784583933.242933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784583933.242944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11094:x1871271580171904:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784583933.243058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11094:x1871271580171904:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583933.243065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1784583933.249335:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583933.254853:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172032 00000100:00100000:0.0:1784583933.254869:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172032 00000100:00100000:0.0:1784583933.255014:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:0.0:1784583933.255027:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:11094:x1871271580172032:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1784583933.257646:0:9809:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2574us 00000100:00080000:2.0:1784583933.262886:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583933.289963:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:11094:x1871271580172032:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 34928us (40625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583933.289989:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000040:00080000:0.0:1784583933.742193:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784583933.806291:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784583934.125730:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583934.638589:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583934.638611:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599134208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583934.638710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583934.638775:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599134208 00000100:00100000:0.0:1784583934.638783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599134208 00000100:00100000:0.0:1784583934.638830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784583934.638839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599134208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583934.638877:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583934.638920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599134208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583934.638926:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784583934.638972:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599134208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583935.154024:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583935.249583:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583935.249679:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172160 00000100:00100000:2.0:1784583935.249688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172160 00000100:00080000:0.0:1784583935.249735:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583935.249789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1784583935.249799:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11136:x1871271580172160:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583935.249817:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583935.249858:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee294 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249918:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249931:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249941:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249953:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249959:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.249965:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250002:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250009:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250023:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250029:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583935.250032:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250039:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250050:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397af00) 00010000:00010000:2.0:1784583935.250052:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583935.250055:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250061:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250071:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250076:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250080:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250085:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ba00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583935.250087:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250101:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250108:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98b4092c0500) 00010000:00010000:2.0:1784583935.250110:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583935.250113:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250118:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250145:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47c5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee294 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250155:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397af00) 00010000:00010000:2.0:1784583935.250158:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583935.250161:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee294 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.250169:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583935.250227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11136:x1871271580172160:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 429us (650us total) trans 0 rc 301/301 00000100:00100000:2.0:1784583935.250234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:3.0:1784583935.265558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583935.265667:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172416 00000100:00100000:0.0:1784583935.265677:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172416 00000100:00100000:0.0:1784583935.265735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:0.0:1784583935.265745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11136:x1871271580172416:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:0.0:1784583935.265803:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583935.265840:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47c15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee27f expref: 9 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.265860:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397af00) 00010000:00010000:0.0:1784583935.265871:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583935.265950:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.265964:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.265974:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.265987:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.265994:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266000:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266506:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266517:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266525:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583935.266540:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005172f70 reply state 000000008ea4e905 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266560:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266567:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:0.0:1784583935.266570:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583935.266572:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784583935.266577:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784583935.266585:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266593:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266600:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266606:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583935.266610:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266617:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266624:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1300) 00010000:00010000:0.0:1784583935.266626:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583935.266629:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266635:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47c70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583935.266658:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005172f70 reply state 000000008ea4e905 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266667:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.266674:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98b301fd1900) 00010000:00010000:0.0:1784583935.266676:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583935.266678:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784583935.266773:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:11136:x1871271580172416:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 1027us (1223us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784583935.266781:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:3.0:1784583935.440550:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583935.440960:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172544 00000100:00100000:1.0:1784583935.441005:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172544 00000100:00100000:1.0:1784583935.441102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1784583935.441113:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:11144:x1871271580172544:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:1.0:1784583935.441158:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583935.441191:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee29b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441306:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441320:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441338:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583935.441407:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784583935.441419:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583935.441460:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441533:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee29b expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441560:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee29b expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.441569:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:1.0:1784583935.441573:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784583935.441584:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce600, rc 0) 00000100:00100000:1.0:1784583935.442050:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:11144:x1871271580172544:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 937us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583935.442058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:0.0:1784583935.532342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583935.533895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172672 00000100:00100000:3.0:1784583935.533921:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172672 00000100:00100000:3.0:1784583935.534237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:3.0:1784583935.534288:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:11150:x1871271580172672:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583935.534368:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583935.534401:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534583:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534599:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534630:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534643:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534662:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.534689:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535061:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535084:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535104:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583935.535208:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784583935.535230:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583935.535327:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535361:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535369:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535376:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535397:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583935.535401:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535421:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535434:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583935.535436:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583935.535461:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535533:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535560:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535594:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535644:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535651:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583935.535668:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535676:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535698:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98b301fd1900) 00010000:00010000:3.0:1784583935.535701:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583935.535704:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535710:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535819:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a2 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535864:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a2 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.535881:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583935.535883:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784583935.535886:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96200, rc 0) 00000100:00100000:3.0:1784583935.536003:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:11150:x1871271580172672:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1741us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583935.536019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:3.0:1784583935.552446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583935.552970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580172928 00000100:00100000:1.0:1784583935.552981:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580172928 00000100:00100000:1.0:1784583935.553114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:1.0:1784583935.553182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:11150:x1871271580172928:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784583935.553216:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583935.553268:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e47caf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2a9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553458:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553575:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553618:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553681:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553697:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.553704:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784583935.557543:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784583935.557764:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557783:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557795:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557834:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557840:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557846:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557866:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583935.557870:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557877:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557889:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583935.557892:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583935.557895:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557900:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47cb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784583935.557913:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093672307 reply state 000000002bdaa6d0 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557923:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.557929:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:1.0:1784583935.557931:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784583935.557934:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784583935.558034:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e47caf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.558067:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583935.558107:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:1.0:1784583935.558110:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583935.558112:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf800, rc 0) 00000100:00100000:1.0:1784583935.558217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:11150:x1871271580172928:12345-192.168.203.51@tcp:101:bash.0 Request processed in 5067us (5798us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784583935.558294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:1.0:1784583935.576352:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583935.579051:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173056 00000100:00100000:3.0:1784583935.579072:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173056 00000100:00100000:3.0:1784583935.579144:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1784583935.579161:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1871271580173056:12345-192.168.203.51@tcp:8:bash.0 00010000:00080000:3.0:1784583935.579194:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:3.0:1784583935.579222:0:8426:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e47cd2 00002000:00100000:3.0:1784583935.579233:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfe5cd00-263a-47c1-b0c6-0ab6049cb709/ffff98b418037800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784583935.579290:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784583935.581022:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784583935.581081:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b3041fa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784583935.581283:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580173056:12345-192.168.203.51@tcp:8:bash.0 Request processed in 2107us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583935.581294:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1784583935.589593:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583935.590309:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173184 00000100:00100000:0.0:1784583935.590321:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173184 00000100:00100000:0.0:1784583935.590409:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1784583935.590420:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580173184:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583935.590440:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583935.590462:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2b0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583935.590524:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784583935.590542:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1784583935.590547:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583935.590557:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.590598:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.590621:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:0.0:1784583935.590689:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:0:x1871271580173184:12345-192.168.203.51@tcp:101:bash.0 Request processed in 262us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583935.590696:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00080000:2.0:1784583935.590895:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583935.613905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583935.614405:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173312 00000100:00100000:3.0:1784583935.614428:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173312 00000100:00100000:3.0:1784583935.614635:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:3.0:1784583935.614646:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11150:x1871271580173312:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583935.614676:0:11860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583935.614708:0:11860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2b7 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.614740:0:11860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.615053:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583935.615081:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583935.615089:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 8 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.615274:0:11860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.615302:0:11860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583935.615316:0:11860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11860:1871271599134336:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583935.618658:0:11860:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1784583935.625797:0:11860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11860:1871271599134336:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583935.625835:0:11860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 8 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.625858:0:11860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:2.0:1784583935.625920:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:11150:x1871271580173312:12345-192.168.203.51@tcp:101:bash.0 Request processed in 11276us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583935.625929:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:0.0:1784583935.628571:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583935.636350:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173440 00000100:00100000:3.0:1784583935.636376:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173440 00010000:00010000:2.0:1784583935.639836:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583935.639943:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:2.0:1784583935.639957:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2399:x1871271580173440:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583935.639985:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583935.640025:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.640040:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.640107:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e47cd9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b0 expref: 8 pid: 8428 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.640171:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583935.640176:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583935.640200:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.640212:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.640307:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583935.640321:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6500:1871271599134464:192.168.203.51@tcp:105: 00000100:00100000:2.0:1784583935.640459:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40d704d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784583935.644842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583935.644931:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173696 00000100:00100000:0.0:1784583935.644950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173696 00000100:00100000:0.0:1784583935.645064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:0.0:1784583935.645077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:11150:x1871271580173696:12345-192.168.203.51@tcp:35:bash.0 00000001:00080000:0.0:1784583935.646006:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:2.0:1784583935.646351:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6500:1871271599134464:192.168.203.51@tcp:105: 00010000:00010000:2.0:1784583935.646392:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583935.646553:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2399:x1871271580173440:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 6599us (18002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583935.646572:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1784583935.648024:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:11150:x1871271580173696:12345-192.168.203.51@tcp:35:bash.0 Request processed in 2944us (3191us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784583935.648046:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000020:00080000:0.0:1784583935.648051:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784583935.773676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583935.774549:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580173952 00000100:00100000:0.0:1784583935.774561:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580173952 00000100:00100000:0.0:1784583935.774627:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:0.0:1784583935.774638:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:11160:x1871271580173952:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583935.774661:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583935.774682:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2be expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583935.775290:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784583935.775388:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47ce7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2be expref: 19 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.775402:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:0.0:1784583935.775405:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583935.778134:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2be expref: 19 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583935.778161:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:0.0:1784583935.778239:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:11160:x1871271580173952:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 3601us (4570us total) trans 4294967316 rc 301/301 00000100:00100000:0.0:1784583935.778247:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:1.0:1784583935.788272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583935.788366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580174208 00000100:00100000:0.0:1784583935.788375:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580174208 00000100:00100000:0.0:1784583935.788444:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1784583935.788456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:11160:x1871271580174208:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583935.789317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:11160:x1871271580174208:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 304us (505us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1784583935.789331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784583935.971064:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583935.971154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580174336 00000100:00100000:2.0:1784583935.971164:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580174336 00000100:00100000:2.0:1784583935.971224:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784583935.971235:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:11166:x1871271580174336:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583935.971271:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583935.971294:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971375:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971390:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971403:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583935.971465:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784583935.971501:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583935.971525:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971551:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2c5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971571:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2c5 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.971580:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583935.971583:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583935.971587:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a400, rc 0) 00000100:00100000:2.0:1784583935.971651:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11166:x1871271580174336:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 418us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583935.971658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784583935.981432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583935.981601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580174592 00000100:00100000:3.0:1784583935.981620:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580174592 00000100:00100000:3.0:1784583935.981686:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1784583935.981696:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11166:x1871271580174592:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583935.981716:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583935.981736:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.981847:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47d0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.981863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.981877:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583935.981905:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784583935.982029:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2cc expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.982047:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47d0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2cc expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583935.982056:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:3.0:1784583935.982059:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583935.982062:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96c00, rc 0) 00000100:00100000:3.0:1784583935.982182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11166:x1871271580174592:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 488us (775us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784583935.982190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1784583935.985825:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583935.985927:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580174848 00000100:00100000:2.0:1784583935.985950:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580174848 00000100:00100000:2.0:1784583935.986022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1784583935.986032:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11166:x1871271580174848:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583935.986061:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583935.986085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47d18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.986206:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.986221:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.986234:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583935.986247:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784583935.986373:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47d18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2d3 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.986392:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2d3 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.986402:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:2.0:1784583935.986404:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784583935.986408:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ae00, rc 0) 00000100:00100000:2.0:1784583935.986629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:11166:x1871271580174848:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 597us (814us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1784583935.986638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:1.0:1784583935.989165:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583935.994376:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580174976 00000100:00100000:2.0:1784583935.994396:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580174976 00000100:00100000:2.0:1784583935.994874:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1784583935.994887:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:2399:x1871271580174976:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583935.994903:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583935.994930:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47d0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2cc expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.994953:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:2.0:1784583935.994959:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583935.995035:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:2399:x1871271580174976:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 151us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583935.995043:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784583935.997293:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583935.997386:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175104 00000100:00100000:2.0:1784583935.997397:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175104 00000100:00100000:2.0:1784583935.997601:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:2.0:1784583935.997623:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580175104:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:2.0:1784583935.997670:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.997692:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.997701:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784583935.997705:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583935.997710:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.997776:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583935.997791:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 7 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583935.997808:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1871271599134592:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583935.998054:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43e8be780 going to sleep for 11 seconds 00000100:00100000:3.0:1784583936.001301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.001378:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175232 00000100:00100000:0.0:1784583936.001386:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175232 00002000:00100000:0.0:1784583936.001439:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98b409219880 x1871271580175232/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:262/0 lens 504/0 e 0 to 0 dl 1784583947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583936.001451:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b409219880 with x1871271580175232 ext(0->12) 00010000:00010000:0.0:1784583936.001490:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 8 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.001507:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 8 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583936.001516:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b409219880 00000100:00100000:0.0:1784583936.001548:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784583936.001559:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580175232:12345-192.168.203.51@tcp:4:lfs.0 00000001:00100000:0.0:1784583936.003873:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000100:00100000:2.0:1784583936.004481:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1871271599134592:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583936.004508:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583936.004929:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2400:x1871271580175232:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 3370us (3636us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784583936.004939:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00002000:00100000:0.0:1784583936.004952:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98b409219880 x1871271580175232/t4294967300(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:262/0 lens 504/448 e 0 to 0 dl 1784583947 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583936.004962:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b409219880 with x1871271580175232 ext(0->12) 00010000:00010000:0.0:1784583936.004971:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.004985:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583936.004993:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b409219880 00000100:00100000:3.0:1784583936.010616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.010777:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175360 00000100:00100000:0.0:1784583936.010789:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175360 00010000:00010000:0.0:1784583936.010854:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583936.010908:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:0.0:1784583936.010920:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580175360:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583936.010941:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784583936.010962:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784583936.010965:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784583936 00002000:00010000:0.0:1784583936.010967:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784583936 00002000:00010000:0.0:1784583936.010969:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784583936 00002000:00010000:0.0:1784583936.010971:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784583936.010977:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.010992:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.011021:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e964432/0xdab2421a42e47ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2b7 expref: 9 pid: 11860 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.011042:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583936.011047:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583936.011053:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.011063:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.011113:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583936.011170:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580175360:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 252us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.011178:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00010000:00010000:1.0:1784583936.011328:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011338:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011359:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011368:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011375:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011392:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583936.011397:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011405:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011419:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.011426:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e47d2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583936.011513:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580175104:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 13893us (14227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.011521:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:1.0:1784583936.016232:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.016312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175616 00000100:00100000:3.0:1784583936.016322:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175616 00000100:00100000:3.0:1784583936.016377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784583936.016387:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:11166:x1871271580175616:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:3.0:1784583936.016461:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2d3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583936.016734:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1784583936.016916:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1784583936.017224:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1784583936.017359:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.017377:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.017386:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.017527:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.017545:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 27 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.017563:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304116300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599134720:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583936.017886:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff600 going to sleep for 11 seconds 00000100:00100000:3.0:1784583936.021026:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304116300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599134720:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583936.021054:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583936.024635:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.025865:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175744 00000100:00100000:3.0:1784583936.025878:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175744 00010000:00010000:3.0:1784583936.025924:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 28 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.025976:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:3.0:1784583936.025986:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:2401:x1871271580175744:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583936.026022:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583936.026030:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 28 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026044:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 28 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026068:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47cc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a9 expref: 28 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026088:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:3.0:1784583936.026095:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026105:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026113:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.026393:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583936.026462:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:2401:x1871271580175744:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 475us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.026523:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00010000:00010000:2.0:1784583936.026771:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.026780:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784583936.026918:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:2.0:1784583936.027050:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1784583936.027338:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599134848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583936.027393:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.027431:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583936.027510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599134848 00000100:00100000:0.0:1784583936.027517:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599134848 00000100:00100000:0.0:1784583936.027570:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784583936.027580:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599134848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784583936.027653:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599134848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.027661:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1784583936.028266:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583936.028301:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599134848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784583936.028516:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1784583936.028596:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599134976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583936.028773:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.028794:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583936.028973:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599134976 00000100:00100000:0.0:1784583936.028979:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599134976 00000100:00100000:0.0:1784583936.029014:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784583936.029022:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599134976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784583936.029165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1871271599134976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 141us (390us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784583936.029173:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784583936.029810:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599134976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784583936.029882:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1784583936.029924:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029935:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029944:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029950:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583936.029955:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029963:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029979:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:2.0:1784583936.029982:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784583936.029987:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.029994:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d34 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784583936.030098:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784583936.030186:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1784583936.030198:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379215729332ns, next at 380215727417ns, rc = 0 00000001:00080000:2.0:1784583936.030205:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:2.0:1784583936.030227:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a900) 00010000:00010000:2.0:1784583936.030230:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784583936.030237:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47d1f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2d3 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583936.030574:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11166:x1871271580175616:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 14186us (14351us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784583936.030583:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000020:00080000:2.0:1784583936.030588:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784583936.036436:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.036632:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580175872 00000100:00100000:0.0:1784583936.036643:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580175872 00000100:00100000:0.0:1784583936.036706:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:0.0:1784583936.036716:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11166:x1871271580175872:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583936.036741:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583936.036774:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47d3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2da expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.036866:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47d3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2da expref: 31 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.036884:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47d3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2da expref: 31 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.036902:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583936.036905:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583936.036909:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1ca00, rc 0) 00000100:00100000:0.0:1784583936.036971:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+31:11166:x1871271580175872:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 257us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.036978:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:1.0:1784583936.040220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.040309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176128 00000100:00100000:0.0:1784583936.040320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176128 00000100:00100000:0.0:1784583936.040380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1784583936.040391:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+31:11166:x1871271580176128:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583936.040812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11166:x1871271580176128:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 421us (600us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1784583936.040819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784583936.095308:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.095353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.095382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.095430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.095461:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176512 00000100:00100000:2.0:1784583936.095495:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176512 00000100:00100000:2.0:1784583936.095549:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176384 00000100:00100000:2.0:1784583936.095553:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176384 00000100:00100000:2.0:1784583936.095570:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176640 00000100:00100000:2.0:1784583936.095573:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176640 00000100:00100000:2.0:1784583936.095590:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 263 00000100:00100000:2.0:1784583936.095599:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580176512:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583936.095685:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580176512:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.095693:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 263 00000100:00100000:2.0:1784583936.095987:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 264 00000100:00100000:2.0:1784583936.096011:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580176384:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583936.096040:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580176384:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.096052:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 264 00000100:00100000:2.0:1784583936.096067:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 265 00000100:00100000:2.0:1784583936.096073:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580176640:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583936.096101:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580176640:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.096109:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 265 00000100:00080000:2.0:1784583936.096127:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583936.096131:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583936.096461:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176256 00000100:00100000:0.0:1784583936.096486:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176256 00000100:00100000:0.0:1784583936.096521:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 373 00000100:00100000:0.0:1784583936.096529:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580176256:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583936.096558:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580176256:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 30us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.096575:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 373 00000100:00100000:1.0:1784583936.137067:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.138070:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580176896 00000100:00100000:2.0:1784583936.138082:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580176896 00000100:00100000:2.0:1784583936.138146:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:2.0:1784583936.138156:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11176:x1871271580176896:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583936.138180:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583936.138201:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2e1 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583936.138306:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784583936.138414:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47d42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e1 expref: 34 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.138430:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:2.0:1784583936.138433:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784583936.138439:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e1 expref: 34 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.138506:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784583936.138575:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11176:x1871271580176896:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 419us (1516us total) trans 4294967330 rc 301/301 00000100:00100000:2.0:1784583936.138583:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:2.0:1784583936.141041:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.141200:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580177024 00000100:00100000:3.0:1784583936.141210:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580177024 00000100:00100000:3.0:1784583936.141271:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1784583936.141281:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11176:x1871271580177024:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1784583936.141368:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141386:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141398:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141528:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141537:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141544:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141775:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141784:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141792:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583936.141852:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141910:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141928:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141934:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141940:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.141944:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141952:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141964:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583936.141967:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583936.141972:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141977:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141990:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.141996:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142002:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142007:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.142016:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142022:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142030:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:3.0:1784583936.142032:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583936.142035:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142040:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142050:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142056:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142062:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142068:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.142071:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142076:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142082:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.142084:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583936.142093:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.142099:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.142177:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11176:x1871271580177024:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 896us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.142186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:0.0:1784583936.145914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.146061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580177280 00000100:00100000:2.0:1784583936.146071:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580177280 00000100:00100000:2.0:1784583936.146122:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1784583936.146132:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11176:x1871271580177280:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583936.147239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11176:x1871271580177280:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 1102us (1329us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1784583936.147249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1784583936.173902:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583936.173927:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583936.173998:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583936.174060:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784583936.174070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599135232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583936.174093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583936.174126:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135104 00000100:00100000:3.0:1784583936.174133:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135104 00000100:00100000:3.0:1784583936.174174:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135232 00000100:00100000:3.0:1784583936.174178:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135232 00000100:00100000:3.0:1784583936.174216:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784583936.174225:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599135104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583936.174248:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784583936.174654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583936.174692:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583936.174703:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599135232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583936.174732:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583936.175357:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583936.175370:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583936.175410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784583936.175495:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583936.175972:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599135104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1746us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.175981:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784583936.176003:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135360 00000100:00100000:3.0:1784583936.176008:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135360 00000100:00100000:3.0:1784583936.176044:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784583936.176052:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599135360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583936.176080:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583936.176107:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599135360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.176113:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1784583936.176131:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583936.176165:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583936.176370:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599135232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1669us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.176377:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583936.176404:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599135488:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.176439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.176463:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583936.176486:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599135616:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.176513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.176548:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135488 00000100:00100000:2.0:1784583936.176552:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135488 00000100:00100000:2.0:1784583936.176579:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1784583936.176585:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599135488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.176619:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599135488:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.176625:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1784583936.176658:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599135488:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.176678:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135616 00000100:00100000:2.0:1784583936.176681:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135616 00000100:00100000:2.0:1784583936.176707:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784583936.176713:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599135616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.176747:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599135616:12345-0@lo:400:kworker.0 Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.176753:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784583936.176777:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599135616:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.177504:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599136000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583936.177539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.177563:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599136512:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.177584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.177599:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784583936.177617:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599136128:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.177642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583936.177659:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599136640:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.177679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583936.178040:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136512 00000100:00100000:1.0:1784583936.178048:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136512 00000100:00080000:1.0:1784583936.178072:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583936.178107:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784583936.178114:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599136512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.178162:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599136512:12345-0@lo:400:kworker.0 Request processed in 48us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.178168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784583936.178251:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136000 00000100:00100000:3.0:1784583936.178375:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136000 00000100:00100000:3.0:1784583936.178420:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784583936.178427:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599136000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784583936.178442:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583936.178501:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599136000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.178507:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784583936.178699:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599135872:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.178754:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599135744:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.178793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.178812:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599136256:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.178855:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136128 00000100:00100000:0.0:1784583936.178860:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136128 00000100:00100000:0.0:1784583936.178879:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135744 00000100:00100000:0.0:1784583936.178882:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135744 00000100:00100000:0.0:1784583936.178894:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784583936.178899:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599136128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.178933:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599136128:12345-0@lo:400:kworker.0 Request processed in 33us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.178940:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784583936.178951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784583936.178957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599135744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.178988:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599135744:12345-0@lo:400:kworker.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.178993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784583936.179615:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599136000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583936.179631:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599136512:0@lo:400:kworker.0 00000100:00100000:2.0:1784583936.179655:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599136128:0@lo:400:kworker.0 00000100:00080000:1.0:1784583936.180234:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583936.180695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.180767:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599136384:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.180810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.180871:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599135232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583936.180905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.180934:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599136768:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.180961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.180993:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784583936.181013:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599135744:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.181033:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136640 00000100:00100000:0.0:1784583936.181038:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136640 00000100:00100000:0.0:1784583936.181076:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599135872 00000100:00100000:0.0:1784583936.181079:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599135872 00000100:00100000:0.0:1784583936.181090:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136384 00000100:00100000:0.0:1784583936.181092:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136384 00000100:00100000:0.0:1784583936.181103:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136256 00000100:00100000:0.0:1784583936.181105:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136256 00000100:00100000:0.0:1784583936.181122:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784583936.181128:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599136640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181624:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599136768 00000100:00100000:1.0:1784583936.181629:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599136768 00000100:00100000:1.0:1784583936.181664:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784583936.181671:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599136768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181720:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599136768:12345-0@lo:400:kworker.0 Request processed in 49us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.181737:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1784583936.181770:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583936.181775:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583936.181797:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599136768:0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181818:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784583936.181836:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599135872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181875:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599135872:12345-0@lo:400:kworker.0 Request processed in 51us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.181882:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784583936.181896:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784583936.181902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599136384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599136384:12345-0@lo:400:kworker.0 Request processed in 28us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.181934:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784583936.181946:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784583936.181951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599136256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.181991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599136256:12345-0@lo:400:kworker.0 Request processed in 40us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.181998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784583936.182021:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599136256:0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.182046:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599135872:0@lo:400:kworker.0 00010000:00080000:1.0:1784583936.182058:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30413bb80 x1871271599136384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583936.182068:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599136384:0@lo:400:kworker.0 00000100:00100000:0.0:1784583936.182613:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599136640:12345-0@lo:400:kworker.0 Request processed in 1481us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.182621:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1784583936.182981:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30404e680 x1871271599136640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583936.182992:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599136640:0@lo:400:kworker.0 00000100:00100000:1.0:1784583936.202191:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.202731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580177536 00000100:00100000:3.0:1784583936.202742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580177536 00000100:00100000:3.0:1784583936.202990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:3.0:1784583936.203002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11179:x1871271580177536:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583936.203028:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583936.203049:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2e8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203120:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203134:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203163:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203175:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203183:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203189:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203313:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203323:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203329:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583936.203339:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784583936.203418:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203426:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203437:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203443:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.203453:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203461:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203492:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583936.203496:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583936.203500:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203507:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47d6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203532:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203538:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203543:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203548:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.203551:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203556:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203572:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:3.0:1784583936.203575:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583936.203585:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203591:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47d73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203637:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47d65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203652:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.203660:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.203662:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583936.203665:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583936.203734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11179:x1871271580177536:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 735us (1552us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1784583936.204667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1784583936.206364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.206510:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580177664 00000100:00100000:3.0:1784583936.206519:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580177664 00000100:00100000:3.0:1784583936.206572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1784583936.206582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11179:x1871271580177664:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1784583936.207039:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207057:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207068:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207122:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207129:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207136:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207142:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583936.207147:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207217:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207229:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.207233:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583936.207237:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.207244:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47d88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.207374:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11179:x1871271580177664:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 793us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.207382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1784583936.210564:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.210909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580177920 00000100:00100000:0.0:1784583936.210918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580177920 00000100:00100000:0.0:1784583936.211036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:0.0:1784583936.211046:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11179:x1871271580177920:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583936.213196:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:11179:x1871271580177920:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 2142us (2633us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784583936.213223:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1784583936.413397:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.413568:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580178176 00000100:00100000:0.0:1784583936.413577:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580178176 00000100:00100000:0.0:1784583936.413675:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:0.0:1784583936.413687:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:11210:x1871271580178176:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1784583936.413716:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583936.413737:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47d8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2ef expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.413854:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47d96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.413869:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.413880:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583936.413890:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784583936.414010:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47d8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2ef expref: 40 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.414029:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2ef expref: 39 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.414038:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583936.414040:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784583936.414043:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:0.0:1784583936.414118:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11210:x1871271580178176:12345-192.168.203.51@tcp:101:cat.0 Request processed in 433us (731us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1784583936.414126:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:1.0:1784583936.417123:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.417385:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580178304 00000100:00100000:0.0:1784583936.417394:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580178304 00000100:00100000:0.0:1784583936.417459:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784583936.417487:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:2401:x1871271580178304:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583936.417501:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583936.417523:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47d96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2ef expref: 39 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.417540:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583936.417544:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583936.417596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.417605:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:2401:x1871271580178304:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 137us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583936.417612:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1784583936.417711:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580178560 00000100:00100000:3.0:1784583936.417716:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580178560 00000100:00100000:3.0:1784583936.417755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1784583936.417777:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:11210:x1871271580178560:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:3.0:1784583936.418226:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11210:x1871271580178560:12345-192.168.203.51@tcp:35:cat.0 Request processed in 449us (630us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1784583936.418234:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784583936.460230:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.460297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580178816 00000100:00100000:3.0:1784583936.460307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580178816 00000100:00100000:3.0:1784583936.460418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:3.0:1784583936.460429:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11216:x1871271580178816:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:3.0:1784583936.460453:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583936.460456:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784583936.460512:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47cfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2c5 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460532:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583936.460537:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583936.460552:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47da4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2f6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460652:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460666:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460674:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460704:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.460732:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 39 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.460746:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599136896:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583936.460845:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff540 going to sleep for 11 seconds 00000100:00100000:1.0:1784583936.465439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.465509:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580178944 00000100:00100000:2.0:1784583936.465518:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580178944 00010000:00010000:2.0:1784583936.465559:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 40 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583936.465597:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:2.0:1784583936.465607:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:2401:x1871271580178944:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583936.465625:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583936.465633:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 40 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465648:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 40 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.465670:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599136896:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583936.465673:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47d7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2e8 expref: 40 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465692:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583936.465697:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465707:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465728:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.465746:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465748:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583936.465759:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.465766:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583936.465784:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:2.0:1784583936.465812:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:2401:x1871271580178944:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.465821:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00010000:00010000:2.0:1784583936.465970:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47da4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465986:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.465995:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583936.465997:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784583936.466000:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:2.0:1784583936.466037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11216:x1871271580178816:12345-192.168.203.51@tcp:101:dd.0 Request processed in 5610us (5814us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784583936.466044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1784583936.469325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.469417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580179072 00000100:00100000:3.0:1784583936.469427:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580179072 00000100:00100000:3.0:1784583936.469509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1784583936.470148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11216:x1871271580179072:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784583936.470171:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583936.470188:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47db9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee2fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470219:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470240:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470247:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470702:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47db9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470723:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.470732:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583936.470744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784583936.470749:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ac00, rc 0) 00000100:00100000:2.0:1784583936.470837:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:11216:x1871271580179072:12345-192.168.203.51@tcp:101:dd.0 Request processed in 1319us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.470844:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:1.0:1784583936.472936:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.473164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580179328 00000100:00100000:3.0:1784583936.473173:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580179328 00000100:00100000:3.0:1784583936.473217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:3.0:1784583936.473228:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:11216:x1871271580179328:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:3.0:1784583936.473450:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.473495:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.473520:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583936.473561:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1784583936.473583:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024842c36 reply state 00000000a724a565 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.473594:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.473599:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.473609:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583936.473612:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583936.473682:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:11216:x1871271580179328:12345-192.168.203.51@tcp:36:dd.0 Request processed in 456us (750us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1784583936.473688:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000020:00080000:3.0:1784583936.473692:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784583936.686160:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30404f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599137024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583936.686229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583936.686280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.686427:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580179456 00000100:00100000:0.0:1784583936.686436:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580179456 00000100:00100000:0.0:1784583936.686551:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:0.0:1784583936.686561:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:11230:x1871271580179456:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:0.0:1784583936.686610:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583936.686632:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47dce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee304 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.687242:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.687456:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599137024 00000100:00100000:3.0:1784583936.687463:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599137024 00000100:00100000:3.0:1784583936.687529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784583936.687537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599137024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583936.687562:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00010000:00010000:0.0:1784583936.688462:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.688521:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.688624:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.688635:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.688654:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583936.691519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599137024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3972us (5279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583936.691535:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784583936.692096:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30404f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599137024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583936.692617:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.692646:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.692668:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.694483:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.694521:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 44 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583936.694590:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599137152:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583936.696536:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af7840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583936.700536:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599137152:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583936.700566:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583936.700834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.701101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580179712 00000100:00100000:3.0:1784583936.701108:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580179712 00000100:00100000:3.0:1784583936.701164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:3.0:1784583936.701174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+45:6167:x1871271580179712:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784583936.701807:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:6167:x1871271580179712:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 631us (972us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1784583936.701815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1784583936.705379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.705493:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580179840 00000100:00100000:2.0:1784583936.705503:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580179840 00010000:00010000:2.0:1784583936.705541:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 46 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583936.705629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:2.0:1784583936.705640:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:2401:x1871271580179840:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583936.705655:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583936.705662:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 46 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705683:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 46 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705706:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47dab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2f6 expref: 46 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705733:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583936.705866:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705878:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705885:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.705921:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583936.705976:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+45:2401:x1871271580179840:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 338us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.705984:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00010000:00010000:1.0:1784583936.706043:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706051:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583936.706103:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784583936.706108:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583936.706145:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706158:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706168:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706175:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706182:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706189:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583936.706193:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706200:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706210:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583936.706213:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583936.706218:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706232:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e47dd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706244:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706262:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706269:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706275:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583936.706278:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706284:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706293:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:1.0:1784583936.706296:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583936.706299:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706306:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e47ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706337:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e47dce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee304 expref: 45 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706351:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee304 expref: 44 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583936.706365:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583936.706368:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583936.706370:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8200, rc 0) 00000100:00100000:1.0:1784583936.706397:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:11230:x1871271580179456:12345-192.168.203.51@tcp:101:stat.0 Request processed in 19838us (20121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583936.706404:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:1.0:1784583936.761895:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583936.761975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580180096 00000100:00100000:3.0:1784583936.761984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580180096 00000100:00100000:3.0:1784583936.762050:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:3.0:1784583936.762061:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:11236:x1871271580180096:12345-192.168.203.51@tcp:36:truncate.0 00010000:00010000:3.0:1784583936.762115:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583936.762143:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e47de3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee304 expref: 44 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.762162:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.762167:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583936.762349:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.762377:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.762388:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583936.762834:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:3.0:1784583936.762858:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9970eb2 reply state 0000000034387497 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.762869:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583936.762891:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583936.762894:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583936.762896:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583936.762999:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:11236:x1871271580180096:12345-192.168.203.51@tcp:36:truncate.0 Request processed in 938us (1112us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1784583936.763006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000020:00080000:3.0:1784583936.763011:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784583936.870392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.870557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580180224 00000100:00100000:2.0:1784583936.870566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580180224 00000100:00100000:2.0:1784583936.870647:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583936.870658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:11250:x1871271580180224:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:2.0:1784583936.870681:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583936.870703:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47df1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee30b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870931:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870946:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870959:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870970:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870977:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.870984:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871073:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871089:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583936.871243:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1784583936.871248:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583936.871281:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871304:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871313:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871319:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871326:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871332:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583936.871336:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871344:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871356:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583936.871359:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583936.871363:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871370:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47df8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871383:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871390:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871402:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871407:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7be00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583936.871410:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871417:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871425:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:2.0:1784583936.871427:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583936.871430:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871435:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47dff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871464:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47df1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871533:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583936.871540:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583936.871542:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583936.871545:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583936.871899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:11250:x1871271580180224:12345-192.168.203.51@tcp:101:stat.0 Request processed in 1240us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583936.871917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583936.985738:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583936.985825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580180480 00000100:00100000:0.0:1784583936.985833:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580180480 00000100:00100000:0.0:1784583936.985883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1784583936.985890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:11260:x1871271580180480:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583936.985907:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583936.985923:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e47e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee312 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583936.986030:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784583936.986117:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e47e0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee312 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.986129:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:0.0:1784583936.986131:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583936.986134:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e47e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee312 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583936.986149:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9000, rc 0) 00000100:00100000:0.0:1784583936.986212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+48:11260:x1871271580180480:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 323us (483us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1784583936.986217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:3.0:1784583936.991190:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583936.991319:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580180736 00000100:00100000:2.0:1784583936.991330:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580180736 00000100:00100000:2.0:1784583936.991421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784583936.991432:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+48:11260:x1871271580180736:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583936.991692:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:11260:x1871271580180736:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 261us (511us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1784583936.991700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1784583937.104030:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.108444:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580180992 00000100:00100000:0.0:1784583937.108461:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580180992 00000100:00100000:0.0:1784583937.108583:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:0.0:1784583937.108602:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:11266:x1871271580180992:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583937.108625:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583937.108645:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e47e1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee319 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784583937.108840:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784583937.108926:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.108942:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.108952:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.108990:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.109017:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 50 pid: 6514 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583937.109032:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599137280:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583937.109546:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af7840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583937.114980:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599137280:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583937.115012:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583937.115182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.115282:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580181120 00000100:00100000:0.0:1784583937.115290:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580181120 00010000:00010000:0.0:1784583937.115328:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 51 pid: 6514 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583937.115373:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1784583937.115384:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:2400:x1871271580181120:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583937.115399:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583937.115406:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 51 pid: 6514 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115418:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 51 pid: 6514 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115442:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47e06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee30b expref: 51 pid: 6514 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115458:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583937.115463:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115524:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115532:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.115578:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583937.115632:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:2400:x1871271580181120:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 250us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583937.115641:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00010000:00010000:3.0:1784583937.116004:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.116013:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583937.116031:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1784583937.116156:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e47e1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 51 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.116172:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 50 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.116180:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.116183:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583937.116186:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:3.0:1784583937.116213:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:11266:x1871271580180992:12345-192.168.203.51@tcp:101:bash.0 Request processed in 7622us (12197us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1784583937.116221:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1784583937.120700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.123017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580181376 00000100:00100000:0.0:1784583937.123031:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580181376 00000100:00100000:0.0:1784583937.123263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:0.0:1784583937.123277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:11266:x1871271580181376:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:0.0:1784583937.123905:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.123924:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.123936:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583937.123978:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:0.0:1784583937.124012:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000148feb12 reply state 00000000485d9c51 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.124026:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.124033:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583937.124036:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583937.124040:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784583937.124540:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11266:x1871271580181376:12345-192.168.203.51@tcp:36:bash.0 Request processed in 1264us (3845us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784583937.124549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000020:00080000:1.0:1784583937.124556:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784583937.137186:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.137323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580181504 00000100:00100000:2.0:1784583937.137332:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580181504 00000100:00100000:2.0:1784583937.137392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:2.0:1784583937.137403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11266:x1871271580181504:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583937.137425:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583937.137445:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47e37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee320 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.137586:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.137603:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.137611:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.137645:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.137665:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 54 pid: 9809 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583937.137679:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30413b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599137408:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583937.137811:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583937.144455:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30413b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599137408:192.168.203.51@tcp:104: 00010000:00010000:1.0:1784583937.144510:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583937.148842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.149313:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580181632 00000100:00100000:0.0:1784583937.149323:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580181632 00010000:00010000:0.0:1784583937.149374:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 55 pid: 9809 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583937.149421:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:0.0:1784583937.149431:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:2401:x1871271580181632:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583937.149445:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583937.149452:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 55 pid: 9809 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149505:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 55 pid: 9809 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149530:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e47e22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee319 expref: 55 pid: 9809 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149547:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583937.149553:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149564:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149572:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.149593:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583937.149702:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:2401:x1871271580181632:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 272us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583937.149711:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00010000:00010000:1.0:1784583937.150069:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.150079:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583937.150136:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784583937.150147:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583937.150170:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.150198:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47e37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee320 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.150214:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee320 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.150222:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583937.150225:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583937.150227:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a400, rc 0) 00000100:00100000:1.0:1784583937.150266:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11266:x1871271580181504:12345-192.168.203.51@tcp:101:bash.0 Request processed in 12865us (13089us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583937.150273:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:2.0:1784583937.153838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.154064:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580181888 00000100:00100000:3.0:1784583937.154075:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580181888 00000100:00100000:3.0:1784583937.154140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1784583937.154149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11266:x1871271580181888:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:3.0:1784583937.154380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:11266:x1871271580181888:12345-192.168.203.51@tcp:35:bash.0 Request processed in 230us (550us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1784583937.154388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00010000:00010000:1.0:1784583937.198229:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583937.272943:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583937.273043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580182144 00000100:00100000:1.0:1784583937.273052:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580182144 00000100:00100000:1.0:1784583937.273120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784583937.273131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:11277:x1871271580182144:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784583937.273153:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583937.273172:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e47e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee327 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583937.273299:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784583937.273383:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e47e45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee327 expref: 56 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.273433:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:1.0:1784583937.273436:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784583937.273442:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e47e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee327 expref: 56 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.273456:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:1.0:1784583937.273570:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11277:x1871271580182144:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 441us (634us total) trans 4294967348 rc 301/301 00000100:00100000:1.0:1784583937.273577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784583937.277046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.277327:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580182272 00000100:00100000:3.0:1784583937.277337:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580182272 00000100:00100000:3.0:1784583937.277395:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:3.0:1784583937.277404:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11277:x1871271580182272:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1784583937.277668:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277684:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277695:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277707:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277714:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277720:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277822:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277843:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277850:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583937.277892:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277905:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277912:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277919:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277924:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.277928:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277935:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277947:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583937.277950:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.277954:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277967:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277991:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.277997:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278004:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278008:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.278012:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278018:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278027:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:3.0:1784583937.278030:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.278032:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278039:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278047:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278052:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278065:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278070:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.278073:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278078:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278085:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.278088:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.278091:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.278096:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583937.278177:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11277:x1871271580182272:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 773us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.278186:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:3.0:1784583937.281196:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.286435:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580182528 00000100:00100000:0.0:1784583937.286455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580182528 00000100:00100000:0.0:1784583937.286574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1784583937.286585:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11277:x1871271580182528:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583937.286866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:11277:x1871271580182528:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 281us (5677us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1784583937.286880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784583937.347832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.347982:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580182784 00000100:00100000:3.0:1784583937.347991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580182784 00000100:00100000:3.0:1784583937.348056:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:3.0:1784583937.348067:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:11280:x1871271580182784:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583937.348097:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583937.348117:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee32e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348225:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348239:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348261:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348274:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348281:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348288:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348386:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348401:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583937.348685:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784583937.348814:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348822:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348836:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348842:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.348846:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348854:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348866:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583937.348868:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.348872:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348878:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47e6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348891:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348898:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348903:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348908:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.348911:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348927:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348935:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:3.0:1784583937.348937:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.348940:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348945:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348980:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47e68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee32e expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.348995:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee32e expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.349002:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.349004:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583937.349006:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583937.349103:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:11280:x1871271580182784:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1036us (1278us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784583937.349111:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:0.0:1784583937.351712:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.351839:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580182912 00000100:00100000:3.0:1784583937.351848:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580182912 00000100:00100000:3.0:1784583937.351910:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1784583937.351920:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:2400:x1871271580182912:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583937.351950:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583937.351973:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47e7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee32e expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.352033:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.352038:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583937.352090:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:2400:x1871271580182912:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 171us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.352097:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1784583937.352584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583937.352721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580183040 00000100:00100000:1.0:1784583937.352725:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580183040 00000100:00100000:1.0:1784583937.352793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:1.0:1784583937.352801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:11280:x1871271580183040:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:1.0:1784583937.352855:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352870:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352881:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352912:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352918:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352932:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352938:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583937.352942:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352950:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352959:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583937.352962:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784583937.352965:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.352971:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47e8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583937.353022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:11280:x1871271580183040:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 221us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583937.353029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:1.0:1784583937.354977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.355665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580183296 00000100:00100000:0.0:1784583937.355674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580183296 00000100:00100000:0.0:1784583937.355727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1784583937.355736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:11280:x1871271580183296:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583937.356188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:11280:x1871271580183296:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 452us (1217us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1784583937.356197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1784583937.481727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.484951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580183552 00000100:00100000:2.0:1784583937.484968:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580183552 00000100:00100000:2.0:1784583937.485050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1784583937.485060:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:11298:x1871271580183552:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:2.0:1784583937.485085:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583937.485105:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47e92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee335 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.485203:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47e99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.485217:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47e99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.485228:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47e99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583937.485238:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784583937.485357:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47e92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee335 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.485396:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47e99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee335 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.485405:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583937.485407:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784583937.485411:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ba00, rc 0) 00000100:00100000:2.0:1784583937.485582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11298:x1871271580183552:12345-192.168.203.51@tcp:101:cat.0 Request processed in 522us (3863us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784583937.485590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1784583937.504005:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.504092:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580183680 00000100:00100000:3.0:1784583937.504100:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580183680 00000100:00100000:3.0:1784583937.504157:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:3.0:1784583937.504167:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11299:x1871271580183680:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583937.504188:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583937.504207:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee33c expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504278:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504291:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504302:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583937.504345:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784583937.504349:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583937.504383:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504406:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee33c expref: 62 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504649:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee33c expref: 61 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.504660:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583937.504663:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583937.504666:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:3.0:1784583937.504728:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11299:x1871271580183680:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 561us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.504735:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:1.0:1784583937.509397:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.509654:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184064 00000100:00100000:0.0:1784583937.509664:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184064 00000100:00100000:0.0:1784583937.509717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1784583937.509728:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11299:x1871271580184064:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784583937.510277:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11299:x1871271580184064:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 550us (889us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1784583937.510286:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1784583937.512799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.512876:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184192 00000100:00100000:3.0:1784583937.512884:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184192 00000100:00100000:3.0:1784583937.512944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1784583937.512955:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11299:x1871271580184192:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:3.0:1784583937.512970:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784583937.512997:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47e3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee320 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.513020:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47e99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee335 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.513034:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e47d3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2da expref: 60 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.513066:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.513071:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583937.513125:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11299:x1871271580184192:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 171us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.513133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:2.0:1784583937.515910:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583937.516024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184320 00000100:00100000:1.0:1784583937.516040:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184320 00000100:00100000:1.0:1784583937.516113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:1.0:1784583937.516123:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11299:x1871271580184320:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:1.0:1784583937.516290:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.516328:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.516341:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784583937.516912:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784583937.517109:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1784583937.517268:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1784583937.517371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11299:x1871271580184320:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 1240us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583937.517381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:1.0:1784583937.536504:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.536632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184448 00000100:00100000:2.0:1784583937.536642:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184448 00000100:00100000:2.0:1784583937.536705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:2.0:1784583937.536715:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11301:x1871271580184448:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583937.536736:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583937.536768:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47ebc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee343 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536833:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536855:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536887:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536894:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536901:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536964:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536972:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.536978:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583937.537014:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784583937.537018:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583937.537035:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537053:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537058:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537074:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537080:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ba00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583937.537085:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537092:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537104:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583937.537107:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583937.537111:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537117:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47ec3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537130:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537136:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537142:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537147:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583937.537150:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537166:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537174:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:2.0:1784583937.537176:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583937.537179:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537185:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47eca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537211:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47ebc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537223:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.537230:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583937.537232:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583937.537235:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784583937.537307:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11301:x1871271580184448:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 593us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583937.537315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00000040:00080000:0.0:1784583937.855267:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583937.855277:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583937.855321:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784583937.855340:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583937.855464:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599137536:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784583937.855582:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583937.865039:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.865162:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599137536:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784583937.865917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184576 00000100:00100000:3.0:1784583937.865927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184576 00000100:00100000:3.0:1784583937.865986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:3.0:1784583937.865996:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11312:x1871271580184576:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784583937.866029:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784583937.866145:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11312:x1871271580184576:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 150us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.866153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:1.0:1784583937.871306:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.871533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184704 00000100:00100000:2.0:1784583937.871543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184704 00000100:00100000:2.0:1784583937.871597:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:2.0:1784583937.871615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11312:x1871271580184704:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784583937.871701:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871731:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871784:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871801:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871829:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871838:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871844:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583937.871889:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784583937.871893:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583937.871909:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871920:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871933:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871940:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871946:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583937.871951:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871959:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871972:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:2.0:1784583937.871976:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583937.871980:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.871987:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47ed8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872001:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872007:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872013:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872017:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ba00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583937.872025:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872031:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872039:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff98b4092c0e00) 00010000:00010000:2.0:1784583937.872041:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583937.872044:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872050:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e47edf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872065:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872071:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872076:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872080:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583937.872082:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872087:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872093:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:2.0:1784583937.872096:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583937.872105:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.872110:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47ee6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583937.872181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11312:x1871271580184704:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 575us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583937.872189:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:2.0:1784583937.874920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.877366:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580184960 00000100:00100000:3.0:1784583937.877381:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580184960 00000100:00100000:3.0:1784583937.877451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:3.0:1784583937.877463:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11312:x1871271580184960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583937.877503:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583937.877526:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47eed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee34a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877634:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877649:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877673:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583937.877685:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784583937.877761:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877768:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877774:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877780:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.877784:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877792:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877805:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583937.877808:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583937.877812:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877818:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47ef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877855:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47eed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee34a expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877878:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:3.0:1784583937.877881:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583937.877884:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47eed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee34a expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.877893:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583937.877960:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580184960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 499us (3048us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1784583937.877967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:1.0:1784583937.882712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.882824:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580185088 00000100:00100000:3.0:1784583937.882835:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580185088 00000100:00100000:3.0:1784583937.882906:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:3.0:1784583937.882918:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580185088:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784583937.882961:0:9809:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784583937.883107:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580185088:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 191us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.883116:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:0.0:1784583937.886324:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.886656:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580185344 00000100:00100000:3.0:1784583937.886666:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580185344 00000100:00100000:1.0:1784583937.886832:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:1.0:1784583937.886847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580185344:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583937.886871:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583937.886875:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784583937.886909:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47eae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee33c expref: 61 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.886927:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583937.886932:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583937.886947:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e47f02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee351 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784583937.888393:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1784583937.888573:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.888592:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.888604:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.888675:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e47f02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee351 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.888693:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee351 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.888702:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b30397ae00) 00010000:00010000:1.0:1784583937.888705:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583937.888708:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce400, rc 0) 00000100:00100000:1.0:1784583937.889766:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11312:x1871271580185344:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2917us (3445us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1784583937.889777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000040:00080000:3.0:1784583937.902343:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784583937.907632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.907823:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580185600 00000100:00100000:3.0:1784583937.907835:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580185600 00000100:00100000:3.0:1784583937.907902:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:3.0:1784583937.907913:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11312:x1871271580185600:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784583937.907977:0:9809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583937.908027:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e47f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee351 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908048:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b30397ae00) 00010000:00010000:3.0:1784583937.908059:0:9809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583937.908084:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908098:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908108:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908123:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908130:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908136:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908183:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908191:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908198:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908204:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.908214:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908222:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908230:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583937.908234:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.908237:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908253:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47f17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908265:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908270:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908276:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908282:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583937.908284:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908290:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908297:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x79e0a42e (ffff98b43e8a9200) 00010000:00010000:3.0:1784583937.908300:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583937.908308:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.908314:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47f1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x79e0a42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583937.908404:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580185600:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 492us (779us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784583937.908411:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:2.0:1784583937.912763:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.912895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580185728 00000100:00100000:3.0:1784583937.912905:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580185728 00000100:00100000:3.0:1784583937.912965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:3.0:1784583937.912975:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11312:x1871271580185728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583937.913067:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583937.913091:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee358 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913125:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913139:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913149:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913256:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913273:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.913289:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583937.913292:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583937.913295:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:3.0:1784583937.913438:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11312:x1871271580185728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 464us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.913445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:3.0:1784583937.920240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.920943:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580185984 00000100:00100000:0.0:1784583937.920954:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580185984 00000100:00100000:0.0:1784583937.921100:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:0.0:1784583937.921112:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11312:x1871271580185984:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784583937.921193:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.921210:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.921221:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784583937.921387:0:9809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1784583937.921398:0:9809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381106929632ns, next at 382106927325ns, rc = 0 00000004:00010000:0.0:1784583937.921448:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000680d758 reply state 00000000e0d12e83 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.921461:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.921653:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:0.0:1784583937.921658:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784583937.921661:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583937.921838:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+64:11312:x1871271580185984:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 727us (1608us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1784583937.921851:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:0.0:1784583937.925063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583937.925135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580186112 00000100:00100000:3.0:1784583937.925143:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580186112 00000100:00100000:3.0:1784583937.925202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:3.0:1784583937.925212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+64:11312:x1871271580186112:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583937.925235:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583937.925265:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee35f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.925323:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.925338:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.925355:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583937.925358:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583937.925362:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983600, rc 0) 00000100:00100000:3.0:1784583937.925811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:11312:x1871271580186112:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 600us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.925831:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:2.0:1784583937.932806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.936270:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580186240 00000100:00100000:0.0:1784583937.936286:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580186240 00000100:00100000:0.0:1784583937.936338:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1784583937.936346:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1871271580186240:12345-192.168.203.51@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1784583937.936380:0:11860:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:0.0:1784583937.936409:0:11860:0:(genops.c:1406:class_connect()) connect: client bfe5cd00-263a-47c1-b0c6-0ab6049cb709, cookie 0xdab2421a42e47f41 00002000:00100000:0.0:1784583937.936420:0:11860:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfe5cd00-263a-47c1-b0c6-0ab6049cb709/ffff98b437662000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784583937.936449:0:11860:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784583937.936563:0:11860:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784583937.936602:0:11860:0:(import.c:65:import_set_state_nolock()) ffff98b437661000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784583937.936786:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2397:x1871271580186240:12345-192.168.203.51@tcp:8:lhsmtool_posix.0 Request processed in 439us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583937.936794:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1784583937.941191:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.941270:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580186368 00000100:00100000:2.0:1784583937.941280:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580186368 00000100:00100000:2.0:1784583937.941361:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1784583937.941372:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:0:x1871271580186368:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784583937.942001:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784583937.944117:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1784583937.944130:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000100:00100000:1.0:1784583937.944296:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:0:x1871271580186368:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 2919us (3103us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784583937.944307:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1784583937.946842:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.947178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580186624 00000100:00100000:0.0:1784583937.947190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580186624 00000100:00100000:0.0:1784583937.947255:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1784583937.947265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:11312:x1871271580186624:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784583937.947547:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11312:x1871271580186624:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 282us (712us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1784583937.947557:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:3.0:1784583937.951230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.951303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580186880 00000100:00100000:0.0:1784583937.951315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580186880 00000100:00100000:0.0:1784583937.951397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1784583937.951408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11312:x1871271580186880:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784583937.951727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11312:x1871271580186880:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 320us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583937.951737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:3.0:1784583937.955384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.955460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187008 00000100:00100000:2.0:1784583937.955522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187008 00000100:00100000:2.0:1784583937.957801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:2.0:1784583937.957836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11312:x1871271580187008:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583937.957859:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583937.957904:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47f48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee366 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958718:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958737:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958758:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583937.958805:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583937.958823:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958852:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e47f48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee366 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958871:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee366 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.958879:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:2.0:1784583937.958882:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784583937.958886:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583937.960327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11312:x1871271580187008:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2493us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583937.960339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:3.0:1784583937.965273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583937.965424:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187136 00000100:00100000:1.0:1784583937.965434:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187136 00000100:00100000:1.0:1784583937.967835:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:1.0:1784583937.967857:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580187136:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583937.967879:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583937.967902:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee36d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784583937.967927:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9702, blocks: 0x0 00010000:00010000:1.0:1784583937.967947:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1784583937.967962:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583937.967975:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.967997:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583937.968013:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:1.0:1784583937.968088:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580187136:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 241us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583937.968095:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:3.0:1784583937.971330:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.971409:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187392 00000100:00100000:2.0:1784583937.971418:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187392 00000100:00100000:2.0:1784583937.971501:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:2.0:1784583937.971511:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11312:x1871271580187392:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784583937.972041:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11312:x1871271580187392:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 113us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583937.972053:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:1.0:1784583937.974862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583937.974974:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187520 00000100:00100000:2.0:1784583937.974989:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187520 00000100:00100000:2.0:1784583937.975141:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1784583937.975151:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:11312:x1871271580187520:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583937.975170:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583937.975188:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee374 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.975228:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.975238:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583937.975250:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583937.975257:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.975295:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583937.975313:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 7 pid: 8429 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583937.975329:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599137664:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583937.975492:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784583937.990143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583937.990182:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187648 00000100:00100000:0.0:1784583937.990193:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187648 00010000:00010000:0.0:1784583937.990241:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 8 pid: 8429 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583937.990296:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:0.0:1784583937.990307:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580187648:12345-192.168.203.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784583937.990319:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599137664:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583937.990324:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583937.990351:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 8 pid: 8429 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.990357:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583937.990494:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ae00, rc 0) 00000100:00100000:3.0:1784583937.990554:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:11312:x1871271580187520:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 15404us (15699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583937.990563:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00010000:00010000:0.0:1784583937.991194:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 7 pid: 8429 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.991230:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b007e96/0xdab2421a42e47f56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee36d expref: 7 pid: 8429 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.991255:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583937.991277:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583937.991287:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.991300:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583937.991347:0:8443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583937.992288:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8443:1871271599137792:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583937.992540:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583937.997625:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8443:1871271599137792:192.168.203.51@tcp:105: 00010000:00010000:0.0:1784583937.997654:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583937.997720:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580187648:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 7413us (7647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583937.997732:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1784583938.001855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.001953:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187776 00000100:00100000:0.0:1784583938.001965:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187776 00002000:00100000:0.0:1784583938.002020:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98b43766c380 x1871271580187776/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:264/0 lens 504/0 e 0 to 0 dl 1784583949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583938.002042:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b43766c380 with x1871271580187776 ext(0->8) 00002000:00010000:0.0:1784583938.002050:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b43766c380 00000100:00100000:0.0:1784583938.002090:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784583938.002100:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580187776:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784583938.005592:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580187776:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 3479us (3737us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784583938.005622:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00002000:00100000:0.0:1784583938.005639:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98b43766c380 x1871271580187776/t4294967303(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:264/0 lens 504/448 e 0 to 0 dl 1784583949 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583938.005649:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b43766c380 with x1871271580187776 ext(0->8) 00002000:00010000:0.0:1784583938.005655:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b43766c380 00000100:00100000:1.0:1784583938.014418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.014629:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580187904 00000100:00100000:2.0:1784583938.014640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580187904 00000100:00100000:2.0:1784583938.014702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:2.0:1784583938.014713:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11312:x1871271580187904:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784583938.031593:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1784583938.031611:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1784583938.031666:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784583938.031683:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b30401e240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784583938.031687:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43e8b9900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b30401ea80 00010000:00010000:1.0:1784583938.031733:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031745:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031769:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784583938.031779:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43e8b9000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b43cae7000 00010000:00010000:1.0:1784583938.031780:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.031788:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031796:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031811:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98b301fd1900) 00010000:00010000:1.0:1784583938.031814:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.031819:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031826:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e47c77 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031844:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031851:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031856:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031862:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.031865:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031881:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031890:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583938.031893:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.031896:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031901:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e47c7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031917:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031922:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031928:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031932:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cec00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.031935:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031941:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031948:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a000) 00010000:00010000:1.0:1784583938.031950:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.031953:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031965:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47cbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031980:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031985:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031991:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.031996:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.032000:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032007:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032017:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583938.032019:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.032022:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032028:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47dc7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032041:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032048:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032060:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032065:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.032068:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032075:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032083:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583938.032085:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.032087:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032093:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e47dea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032106:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032112:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032117:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032123:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.032126:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032143:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.032153:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599137920:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1784583938.032153:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583938.032159:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.032164:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032169:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47e30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032180:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032186:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032192:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032198:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.032201:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032207:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032214:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:1.0:1784583938.032217:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784583938.032220:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032236:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e47f33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.032240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583938.032307:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583938.032315:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599138048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784583938.032340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583938.032388:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599137920 00000100:00100000:3.0:1784583938.032394:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599137920 00000100:00100000:1.0:1784583938.032430:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599138048 00000100:00100000:1.0:1784583938.032435:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599138048 00000100:00100000:3.0:1784583938.032461:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583938.032487:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599137920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784583938.032540:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784583938.032549:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599138048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784583938.032567:0:11860:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1784583938.032593:0:11860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a5e9700, atime: 0x6a5e9700, ctime: 0x6a5e9700, blocks: 0x8 00010000:00010000:1.0:1784583938.032601:0:11860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032615:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1784583938.032620:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583938.032628:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032643:0:11860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032652:0:11860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032659:0:11860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032689:0:11860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784583938.032819:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599138048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 270us (476us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784583938.032828:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1784583938.032852:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583938.032857:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032866:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583938.032869:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032877:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032891:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032899:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e1c7e3/0xdab2421a42e47f64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.032915:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583938.032916:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583938.032918:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583938.032994:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:11312:x1871271580187904:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 18280us (18582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.033003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00002000:00010000:3.0:1784583938.034439:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784583938.034447:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784583938 00002000:00010000:3.0:1784583938.034450:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784583938.034452:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784583938 -> 1784583938 00002000:00010000:3.0:1784583938.034454:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:2.0:1784583938.034608:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1784583938.034710:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599137920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2237us (2469us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784583938.034719:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:3.0:1784583938.034775:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b30405ed80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1784583938.034782:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599138048:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1784583938.034795:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43769ad80/2, rc 0, transno 4294967304 00000020:00080000:2.0:1784583938.034962:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:2.0:1784583938.034974:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583938.034978:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583938.035323:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.035424:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188032 00000100:00100000:2.0:1784583938.035432:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188032 00000100:00100000:2.0:1784583938.035491:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:2.0:1784583938.035500:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580188032:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784583938.035788:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599137920:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1784583938.039800:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1784583938.039818:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1784583938.040981:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580188032:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 5473us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.041003:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:2.0:1784583938.044117:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.044728:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188288 00000100:00100000:3.0:1784583938.044740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188288 00000100:00100000:3.0:1784583938.044816:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:3.0:1784583938.044828:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:11312:x1871271580188288:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784583938.044885:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583938.044911:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e47f4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee366 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.044929:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583938.044933:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583938.044964:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.044978:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.044999:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583938.045117:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e822789 reply state 000000001b5484d1 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.045130:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.045137:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583938.045140:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583938.045143:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583938.045259:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:11312:x1871271580188288:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 433us (1149us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1784583938.045267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:3.0:1784583938.053857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.054899:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188416 00000100:00100000:0.0:1784583938.054910:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188416 00000100:00100000:0.0:1784583938.054984:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:0.0:1784583938.054993:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580188416:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784583938.055136:0:8805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784583938.055140:0:8805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784583938 -> 1784583937 00002000:00010000:0.0:1784583938.055142:0:8805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784583936 00002000:00010000:0.0:1784583938.055144:0:8805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784583938 -> 1784583937 00002000:00010000:0.0:1784583938.055146:0:8805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1784583938.055210:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580188416:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 218us (1362us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784583938.055217:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:0.0:1784583938.059802:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.061325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188672 00000100:00100000:3.0:1784583938.061339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188672 00000100:00100000:3.0:1784583938.061405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:3.0:1784583938.061415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:11312:x1871271580188672:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784583938.061493:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.061512:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.061522:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.061572:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.061586:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 15 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.061601:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599138176:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583938.061700:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1784583938.065368:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583938.065434:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188800 00000100:00100000:1.0:1784583938.065453:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188800 00010000:00010000:1.0:1784583938.065516:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 16 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.065559:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:3.0:1784583938.065568:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599138176:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583938.065571:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:2400:x1871271580188800:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583938.065590:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583938.065594:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065610:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 16 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065625:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 16 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065646:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e47f2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee358 expref: 16 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065661:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:1.0:1784583938.065667:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065676:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065683:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.065710:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583938.065759:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:2400:x1871271580188800:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 193us (400us total) trans 0 rc 0/0 00010000:00010000:3.0:1784583938.065784:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.065785:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00010000:00010000:3.0:1784583938.065801:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065850:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065858:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065865:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065871:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.065876:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065891:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065901:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583938.065904:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784583938.065907:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.065913:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e47f72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.066055:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:11312:x1871271580188672:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 4641us (6263us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784583938.066064:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:2.0:1784583938.081409:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.082941:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580188928 00000100:00100000:3.0:1784583938.082955:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580188928 00000100:00100000:3.0:1784583938.083030:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1784583938.083043:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580188928:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784583938.083088:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.083110:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.083119:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583938.083124:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784583938.083129:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.083174:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.083189:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 7 pid: 8428 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.083204:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1871271599138304:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583938.083300:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1784583938.098130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.098165:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189056 00000100:00100000:0.0:1784583938.098179:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189056 00010000:00010000:0.0:1784583938.098216:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 8 pid: 8428 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583938.098264:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:0.0:1784583938.098276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580189056:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583938.098290:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583938.098310:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 8 pid: 8428 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.098323:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 8 pid: 8428 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.098346:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583938.098350:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583938.098355:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.098365:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.098387:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583938.098431:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580189056:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 159us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583938.098439:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00010000:00010000:2.0:1784583938.098987:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003368806f/0xdab2421a42e47f5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee374 expref: 7 pid: 8428 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583938.099024:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1871271599138304:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583938.099044:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099056:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099063:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099082:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099090:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099098:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099105:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784583938.099108:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099116:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099133:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.099140:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e47f79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583938.099183:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580188928:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 16144us (17785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.099191:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1784583938.102097:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.102168:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189312 00000100:00100000:2.0:1784583938.102178:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189312 00000100:00100000:2.0:1784583938.102256:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:2.0:1784583938.102267:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:11312:x1871271580189312:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784583938.102347:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.102365:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.102375:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.102412:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.102426:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 14 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583938.102448:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138432:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583938.102556:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583938.106390:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583938.106560:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189440 00000100:00100000:1.0:1784583938.106569:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189440 00010000:00010000:1.0:1784583938.106612:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 15 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.106654:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:1.0:1784583938.106664:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:2401:x1871271580189440:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583938.106677:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583938.106685:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 15 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.106698:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 15 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.106719:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:1.0:1784583938.106725:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.106736:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.106744:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.106773:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583938.106828:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:2401:x1871271580189440:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583938.106846:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00010000:00010000:3.0:1784583938.107268:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47dc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2fd expref: 14 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.107285:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138432:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583938.107304:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107314:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107320:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107570:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107583:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107659:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107688:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.107701:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 14 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.107716:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138560:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583938.107886:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583938.116411:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138560:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583938.116444:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583938.116604:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.116652:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189568 00000100:00100000:0.0:1784583938.116660:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189568 00010000:00010000:0.0:1784583938.116704:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 15 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583938.116745:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:0.0:1784583938.116785:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:2401:x1871271580189568:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583938.116800:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583938.116808:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 15 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116820:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 15 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116840:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e47f3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee35f expref: 15 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116855:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:0.0:1784583938.116860:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116870:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116878:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.116904:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583938.116950:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:2401:x1871271580189568:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 191us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583938.116959:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00010000:00010000:3.0:1784583938.117222:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.117231:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583938.117353:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1784583938.117462:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:3.0:1784583938.117532:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1784583938.117679:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599138688:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784583938.117730:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583938.117759:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff600 going to sleep for 11 seconds 00000100:00100000:2.0:1784583938.117907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599138688 00000100:00100000:2.0:1784583938.117914:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599138688 00000100:00100000:2.0:1784583938.117958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784583938.117966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9809:x1871271599138688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784583938.118061:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9809:x1871271599138688:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.118069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784583938.120096:0:9809:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1784583938.120107:0:9809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43769ad80, transno 4294967304 00000100:00100000:0.0:1784583938.120125:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599138688:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1784583938.120287:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:0.0:1784583938.120363:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599138816:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784583938.120428:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583938.120457:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583938.120563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599138816 00000100:00100000:3.0:1784583938.120570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599138816 00000100:00100000:3.0:1784583938.120617:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784583938.120626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9809:x1871271599138816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784583938.120756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9809:x1871271599138816:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (327us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784583938.120764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784583938.121972:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599138816:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784583938.122023:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122034:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122043:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122050:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583938.122055:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122062:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122078:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:0.0:1784583938.122082:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583938.122086:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122093:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47f87 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122130:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122137:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122143:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122149:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583938.122152:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122159:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122169:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:0.0:1784583938.122171:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583938.122174:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122180:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47eb5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122203:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122217:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122226:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122277:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.122294:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 17 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583938.122307:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138944:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583938.122391:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583938.129824:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599138944:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583938.129856:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.135119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.135212:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189696 00000100:00100000:3.0:1784583938.135222:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189696 00010000:00010000:3.0:1784583938.135327:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 18 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.135371:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:3.0:1784583938.135381:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2400:x1871271580189696:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583938.135397:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583938.135404:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 18 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135418:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 18 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135441:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47ed1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee343 expref: 18 pid: 6514 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135497:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583938.135504:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135513:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135521:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135548:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583938.135597:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:2400:x1871271580189696:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 217us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583938.135605:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00010000:00010000:3.0:1784583938.135631:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135638:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135650:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135657:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135664:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135670:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.135681:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135689:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135700:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583938.135703:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.135706:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135712:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e47f8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135725:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135731:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135737:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135743:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.135745:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135751:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135759:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b301fd1800) 00010000:00010000:3.0:1784583938.135761:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583938.135772:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.135778:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e47f80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.135906:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11312:x1871271580189312:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 33641us (33817us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1784583938.135927:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 93 00000020:00080000:3.0:1784583938.135931:0:9809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784583938.137003:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583938.137010:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784583938.137040:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784583938.137047:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784583938.141439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.141791:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580189952 00000100:00100000:3.0:1784583938.141801:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580189952 00000100:00100000:3.0:1784583938.141890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1784583938.141901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11312:x1871271580189952:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784583938.142156:0:6517:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784583938.142187:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:3.0:1784583938.142217:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142254:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142264:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142284:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142290:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.142312:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784583938.142403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:11312:x1871271580189952:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 503us (972us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784583938.142411:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000020:00080000:3.0:1784583938.142416:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784583938.142460:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583938.142491:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.142500:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583938.142504:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.142512:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.142536:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:1.0:1784583938.142539:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784583938.142543:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.142549:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47f95 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.142561:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583938.142562:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583938.142564:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583938.228497:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784583938.383732:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784583938.383742:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784583938.383832:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784583938.383839:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583938.503314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.503389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580190208 00000100:00100000:2.0:1784583938.503399:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580190208 00000100:00100000:2.0:1784583938.503462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:2.0:1784583938.503498:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:11322:x1871271580190208:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583938.503523:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583938.503542:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee37b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.503650:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47fa3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.503673:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.503685:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583938.503698:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784583938.503792:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e47f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee37b expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.503810:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee37b expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.503818:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583938.503820:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784583938.503823:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ac00, rc 0) 00000100:00100000:2.0:1784583938.503879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11322:x1871271580190208:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 384us (574us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784583938.503886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:0.0:1784583938.514975:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583938.516705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580190336 00000100:00100000:1.0:1784583938.516720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580190336 00000100:00100000:1.0:1784583938.516785:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:1.0:1784583938.516796:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11322:x1871271580190336:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:1.0:1784583938.516871:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.516900:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.516911:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.516925:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.516931:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.516936:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517013:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517021:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517027:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784583938.517070:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517082:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517088:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517107:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517113:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.517117:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517126:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517139:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583938.517142:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.517146:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517152:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf800/0xdab2421a42e47fb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517164:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517171:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517178:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517183:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.517186:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517202:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517211:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b30397a400) 00010000:00010000:1.0:1784583938.517213:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.517216:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517221:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517236:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517255:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517262:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517267:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cec00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.517269:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517275:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517282:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b30397a000) 00010000:00010000:1.0:1784583938.517285:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583938.517287:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.517301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e47fbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.518511:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11322:x1871271580190336:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1708us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583938.518523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:3.0:1784583938.578552:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.578591:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580190592 00000100:00100000:3.0:1784583938.578738:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580190592 00000100:00100000:3.0:1784583938.578792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:3.0:1784583938.578802:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11325:x1871271580190592:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583938.578822:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583938.578843:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47fc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee382 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578912:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578926:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578937:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578966:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578973:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.578979:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579079:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579089:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579095:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583938.579104:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784583938.579177:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579185:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579192:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579198:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.579203:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579221:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579233:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583938.579236:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.579264:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579271:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e47fcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579284:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579288:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579293:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579298:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.579300:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579305:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579312:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583938.579315:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.579317:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579332:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47fd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579451:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47fc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579490:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.579497:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583938.579499:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583938.579501:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583938.579560:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11325:x1871271580190592:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 758us (1016us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1784583938.579567:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:3.0:1784583938.589601:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583938.589648:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580190720 00000100:00100000:1.0:1784583938.589658:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580190720 00000100:00100000:1.0:1784583938.589713:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:1.0:1784583938.589723:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11325:x1871271580190720:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:1.0:1784583938.589781:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589797:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589807:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589839:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589846:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589853:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589859:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583938.589863:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589883:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589895:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:1.0:1784583938.589898:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784583938.589903:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583938.589909:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e47fe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.589970:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11325:x1871271580190720:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 248us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583938.589977:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:1.0:1784583938.593224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.593287:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580190976 00000100:00100000:3.0:1784583938.593296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580190976 00000100:00100000:3.0:1784583938.593349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784583938.593359:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11325:x1871271580190976:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583938.593595:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:11325:x1871271580190976:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 237us (378us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1784583938.593603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1784583938.636877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.636970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580191232 00000100:00100000:3.0:1784583938.636979:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580191232 00000100:00100000:3.0:1784583938.637042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:3.0:1784583938.637066:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:10851:x1871271580191232:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583938.637090:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583938.637109:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ff0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee389 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.637229:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.637258:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.637266:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.637299:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.637311:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 24 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.637324:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599139072:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583938.637414:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784583938.640718:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599139072:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583938.640751:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.642175:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.642644:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580191360 00000100:00100000:2.0:1784583938.642654:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580191360 00010000:00010000:2.0:1784583938.642693:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 25 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583938.642756:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583938.642766:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:2400:x1871271580191360:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583938.642782:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583938.642789:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 25 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642801:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 25 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642822:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e47fdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee382 expref: 25 pid: 6515 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642839:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:2.0:1784583938.642844:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642852:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642860:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.642980:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583938.643033:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:2400:x1871271580191360:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 268us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.643041:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00010000:00010000:3.0:1784583938.643412:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.643421:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583938.643439:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784583938.643708:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e47ff0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.643724:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.643731:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583938.643733:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583938.643736:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583938.643821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:10851:x1871271580191232:12345-192.168.203.51@tcp:101:bash.0 Request processed in 6757us (6952us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1784583938.643828:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:1.0:1784583938.649624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.649759:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580191488 00000100:00100000:2.0:1784583938.649782:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580191488 00000100:00100000:2.0:1784583938.649841:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:2.0:1784583938.649851:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:10851:x1871271580191488:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583938.649881:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583938.649903:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e48005 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee390 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.649936:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e4800c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.649949:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e4800c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.649960:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e4800c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.650081:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7be00/0xdab2421a42e48005 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee390 expref: 26 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.650099:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e4800c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee390 expref: 25 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.650107:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:2.0:1784583938.650110:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784583938.650113:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784583938.650169:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:10851:x1871271580191488:12345-192.168.203.51@tcp:101:bash.0 Request processed in 320us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.650176:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:1.0:1784583938.653552:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.653894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580191744 00000100:00100000:0.0:1784583938.653904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580191744 00000100:00100000:0.0:1784583938.653961:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:0.0:1784583938.653970:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:10851:x1871271580191744:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:0.0:1784583938.654230:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.654257:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.654268:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583938.654307:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:0.0:1784583938.654329:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002765ae04 reply state 000000005401be42 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.654341:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.654361:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:0.0:1784583938.654363:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583938.654367:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784583938.654501:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1784583938.654702:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:10851:x1871271580191744:12345-192.168.203.51@tcp:36:bash.0 Request processed in 731us (1233us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1784583938.654709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 100 00000020:00080000:0.0:1784583938.654714:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1784583938.661822:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.661904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580191872 00000100:00100000:3.0:1784583938.661914:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580191872 00000100:00100000:3.0:1784583938.662018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:3.0:1784583938.662030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:10851:x1871271580191872:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583938.662055:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583938.662076:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4801a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee397 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.662130:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4801a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee397 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.662146:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4801a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee397 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.662165:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583938.662179:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583938.662183:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583938.662237:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:10851:x1871271580191872:12345-192.168.203.51@tcp:101:bash.0 Request processed in 210us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583938.662256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:1.0:1784583938.667916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.668073:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192000 00000100:00100000:2.0:1784583938.668092:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192000 00000100:00100000:2.0:1784583938.668268:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:2.0:1784583938.668279:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:10851:x1871271580192000:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583938.668295:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583938.668315:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee39e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784583938.668339:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a5e9701, atime: 0x6a5e9700, ctime: 0x6a5e9701, blocks: 0x8 00010000:00010000:2.0:1784583938.668369:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1784583938.668374:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583938.668383:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.668399:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.668411:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784583938.668493:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:10851:x1871271580192000:12345-192.168.203.51@tcp:101:bash.0 Request processed in 216us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583938.668501:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1784583938.671848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.672124:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192128 00000100:00100000:0.0:1784583938.672134:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192128 00002000:00010000:0.0:1784583938.672195:0:8432:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1784583938.672200:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30405ca80 with x1871271580192128 ext(0->18446744073709551615) 00002000:00010000:0.0:1784583938.672268:0:8432:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30405ca80. 00000100:00100000:0.0:1784583938.672379:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784583938.672434:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580192128:12345-192.168.203.51@tcp:10:bash.0 00002000:00010000:0.0:1784583938.676311:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784583938.676321:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784583937 -> 1784583939 00002000:00010000:0.0:1784583938.676324:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1784583936 -> 1784583936 00002000:00010000:0.0:1784583938.676339:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784583937 -> 1784583939 00002000:00010000:0.0:1784583938.676342:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1784583938.676503:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580192128:12345-192.168.203.51@tcp:10:bash.0 Request processed in 4066us (4624us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784583938.676529:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00002000:00010000:0.0:1784583938.676534:0:8432:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1784583938.676538:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30405ca80 with x1871271580192128 ext(0->18446744073709551615) 00002000:00010000:0.0:1784583938.676545:0:8432:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30405ca80. 00000100:00100000:1.0:1784583938.761140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.761226:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192256 00000100:00100000:3.0:1784583938.761236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192256 00000100:00100000:3.0:1784583938.761306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 102 00000100:00100000:3.0:1784583938.761316:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11339:x1871271580192256:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1784583938.761379:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761396:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761607:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761626:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761634:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761642:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761708:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761718:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761739:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583938.761793:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761804:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761810:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761816:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761821:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.761825:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761831:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761842:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583938.761844:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.761849:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761854:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48028 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761866:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761877:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761882:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761886:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.761888:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761893:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761900:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583938.761903:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.761905:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4802f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761924:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761929:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761934:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761938:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583938.761947:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761952:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761960:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583938.761962:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583938.761965:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.761971:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.762045:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11339:x1871271580192256:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 729us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583938.762053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 102 00000100:00100000:1.0:1784583938.827110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.827204:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192512 00000100:00100000:2.0:1784583938.827213:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192512 00000100:00100000:2.0:1784583938.827284:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:2.0:1784583938.827294:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11342:x1871271580192512:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583938.827346:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583938.827383:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e4803d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3a5 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827600:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827633:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827656:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827698:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827716:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.827724:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828011:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48052 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828021:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828029:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583938.828040:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784583938.828113:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828121:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828133:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828139:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583938.828143:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828150:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828160:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583938.828163:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583938.828168:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828174:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e48044 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828187:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828193:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828198:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828202:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ae00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583938.828205:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828219:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828227:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b4092c0000) 00010000:00010000:2.0:1784583938.828229:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583938.828232:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828247:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ae00/0xdab2421a42e4804b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828287:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ba00/0xdab2421a42e4803d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3a5 expref: 33 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828300:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48052 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3a5 expref: 32 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.828308:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:2.0:1784583938.828309:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784583938.828312:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0c00, rc 0) 00000100:00100000:2.0:1784583938.828376:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11342:x1871271580192512:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1083us (1276us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1784583938.828384:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:1.0:1784583938.837120:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583938.837255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192640 00000100:00100000:0.0:1784583938.837265:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192640 00000100:00100000:0.0:1784583938.837328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:0.0:1784583938.837337:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11342:x1871271580192640:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1784583938.837417:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.837442:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.837452:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.837542:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.837555:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 32 pid: 6515 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583938.837580:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599139200:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583938.838043:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784583938.843876:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599139200:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583938.843907:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583938.845727:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.846096:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580192896 00000100:00100000:3.0:1784583938.846107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580192896 00000100:00100000:3.0:1784583938.846180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1784583938.846190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:6635:x1871271580192896:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784583938.846750:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:6635:x1871271580192896:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 560us (1040us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1784583938.846761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:1.0:1784583938.851090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.851196:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580193024 00000100:00100000:3.0:1784583938.851208:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580193024 00010000:00010000:3.0:1784583938.851259:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 34 pid: 6515 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.851311:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:3.0:1784583938.851348:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:2400:x1871271580193024:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583938.851376:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583938.851384:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 34 pid: 6515 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.851399:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 34 pid: 6515 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.851967:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e47ff7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee389 expref: 34 pid: 6515 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.851999:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583938.852004:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.852029:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.852038:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583938.852072:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583938.852276:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852299:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852393:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852401:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852408:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852425:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583938.852430:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852437:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852461:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:0.0:1784583938.852464:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583938.852484:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583938.852490:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e48060 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583938.853092:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:2400:x1871271580193024:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 1308us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583938.853103:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1784583938.860216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11342:x1871271580192640:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 22865us (23090us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583938.860233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:0.0:1784583938.870282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.870372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580193280 00000100:00100000:3.0:1784583938.870382:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580193280 00000100:00100000:3.0:1784583938.870558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1784583938.870585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:11342:x1871271580193280:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583938.871114:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11342:x1871271580193280:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 533us (827us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1784583938.871123:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1784583938.968751:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583938.968861:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580193536 00000100:00100000:2.0:1784583938.968870:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580193536 00000100:00100000:2.0:1784583938.968928:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:2.0:1784583938.968939:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+33:11353:x1871271580193536:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:2.0:1784583938.968974:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583938.968994:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48067 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3ac expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969066:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969079:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969090:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969103:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969109:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969116:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969214:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4807c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969223:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4807c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969230:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4807c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583938.969251:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1784583938.969330:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969338:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969344:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969351:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583938.969356:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969363:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969375:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583938.969378:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583938.969382:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969389:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e4806e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969402:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969408:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969414:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969420:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583938.969428:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969435:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969443:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b4092c0000) 00010000:00010000:2.0:1784583938.969445:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583938.969448:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969454:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48075 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969544:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48067 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ac expref: 36 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969783:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4807c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ac expref: 35 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583938.969793:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:2.0:1784583938.969795:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583938.969798:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0600, rc 0) 00000100:00100000:2.0:1784583938.969909:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:11353:x1871271580193536:12345-192.168.203.51@tcp:101:cat.0 Request processed in 972us (1166us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1784583938.969918:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:0.0:1784583938.980741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583938.980822:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580193792 00000100:00100000:3.0:1784583938.980831:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580193792 00000100:00100000:3.0:1784583938.980886:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784583938.980896:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:11353:x1871271580193792:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:3.0:1784583938.981177:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11353:x1871271580193792:12345-192.168.203.51@tcp:35:cat.0 Request processed in 280us (443us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784583938.981185:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1784583939.010585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.010666:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194048 00000100:00100000:3.0:1784583939.010676:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194048 00000100:00100000:3.0:1784583939.010761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:3.0:1784583939.010771:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:11354:x1871271580194048:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:3.0:1784583939.010821:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1784583939.010846:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4801a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee397 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010869:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4807c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ac expref: 35 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010883:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48052 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3a5 expref: 34 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010895:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7aa00/0xdab2421a42e4800c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee390 expref: 33 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010921:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583939.010926:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583939.010946:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010957:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010966:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010980:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010986:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.010993:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011070:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011078:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011084:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784583939.011245:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784583939.011283:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1784583939.011294:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382196825124ns, next at 383196822626ns, rc = 0 00010000:00010000:3.0:1784583939.011339:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011348:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011355:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011362:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011368:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011375:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011399:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784583939.011415:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011420:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011426:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011431:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.011435:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011441:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011455:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583939.011458:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784583939.011462:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011513:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48098 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011530:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011535:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011540:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011545:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.011548:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011554:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011560:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.011563:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.011566:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011571:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4808a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583939.011588:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eec2f474 reply state 00000000944f0b9c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011598:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.011604:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583939.011605:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583939.011608:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583939.011676:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11354:x1871271580194048:12345-192.168.203.51@tcp:36:rm.0 Request processed in 906us (1098us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1784583939.011683:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 106 00010000:00010000:1.0:1784583939.012079:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583939.012086:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.012094:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583939.012097:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.012102:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.012110:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:1.0:1784583939.012111:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784583939.012113:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.012117:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4809f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.012125:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583939.012126:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583939.012127:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583939.093149:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.093311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194304 00000100:00100000:3.0:1784583939.093321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194304 00000100:00100000:3.0:1784583939.093382:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:3.0:1784583939.093393:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11360:x1871271580194304:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583939.093417:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.093438:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e480a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093579:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093594:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093607:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093630:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093638:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.093645:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784583939.093940:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784583939.094084:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094094:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094101:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094149:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094157:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094164:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094171:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.094175:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094194:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094207:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.094210:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.094215:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094222:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583939.094247:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bff2f40 reply state 0000000063aaeebb transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094259:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094266:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583939.094269:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583939.094271:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784583939.094298:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e480a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.094321:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:3.0:1784583939.094323:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583939.094326:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96c00, rc 0) 00000100:00100000:3.0:1784583939.094393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:11360:x1871271580194304:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1002us (1263us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784583939.094406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:0.0:1784583939.122952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.123391:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194432 00000100:00100000:1.0:1784583939.123401:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194432 00000100:00100000:1.0:1784583939.123520:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1784583939.123531:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2398:x1871271580194432:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784583939.123548:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583939.123568:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3ba expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784583939.123610:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784583939.123630:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1784583939.123635:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583939.123645:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.123669:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.123684:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:1.0:1784583939.123746:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2398:x1871271580194432:12345-192.168.203.51@tcp:101:bash.0 Request processed in 218us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.123754:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00080000:2.0:1784583939.124003:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583939.130693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.130891:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194560 00000100:00100000:2.0:1784583939.130902:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194560 00000100:00100000:2.0:1784583939.131014:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784583939.131025:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:11360:x1871271580194560:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583939.131053:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583939.131085:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3c1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.131128:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.131153:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583939.131157:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583939.131163:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.131224:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.131259:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583939.131289:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1871271599139328:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583939.131549:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583939.141301:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1871271599139328:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583939.141462:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.141557:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0e00, rc 0) 00000100:00100000:2.0:1784583939.141618:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:11360:x1871271580194560:12345-192.168.203.51@tcp:101:bash.0 Request processed in 10595us (10934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583939.141627:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1784583939.142181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.142228:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194688 00000100:00100000:0.0:1784583939.142244:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194688 00010000:00010000:0.0:1784583939.142279:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.142309:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:0.0:1784583939.142320:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580194688:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583939.142335:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583939.142357:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.142370:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.142391:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e480c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3ba expref: 9 pid: 8426 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.142404:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583939.142408:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583939.142416:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.142427:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.142507:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.142523:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6501:1871271599139456:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583939.142904:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583939.165461:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6501:1871271599139456:192.168.203.51@tcp:105: 00010000:00010000:1.0:1784583939.165525:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583939.167954:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580194688:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 25624us (25762us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.167969:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:2.0:1784583939.172849:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.172938:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580194944 00000100:00100000:3.0:1784583939.172949:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580194944 00000100:00100000:3.0:1784583939.173018:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1784583939.173027:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:11360:x1871271580194944:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:3.0:1784583939.173308:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:11360:x1871271580194944:12345-192.168.203.51@tcp:35:bash.0 Request processed in 281us (2850us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1784583939.173316:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00010000:00010000:1.0:1784583939.247053:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583939.375574:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.375690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195072 00000100:00100000:0.0:1784583939.375699:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195072 00000100:00100000:0.0:1784583939.375762:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:0.0:1784583939.375773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:11376:x1871271580195072:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583939.375798:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583939.375819:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e480d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3c8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.375885:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.375900:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.375913:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583939.375961:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784583939.375964:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583939.375994:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.376017:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e480d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c8 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.376049:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c8 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.376057:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:0.0:1784583939.376060:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583939.376078:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8400, rc 0) 00000100:00100000:0.0:1784583939.376148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11376:x1871271580195072:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 376us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583939.376155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:2.0:1784583939.387419:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.387514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195328 00000100:00100000:3.0:1784583939.387523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195328 00000100:00100000:3.0:1784583939.387629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:3.0:1784583939.387640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:11376:x1871271580195328:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583939.387666:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.387687:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e480e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3cf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.387793:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.387809:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.387821:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583939.387849:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784583939.387944:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e480e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3cf expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.387959:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3cf expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.387967:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:3.0:1784583939.387969:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583939.387973:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583939.388036:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:11376:x1871271580195328:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 397us (626us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1784583939.388043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:2.0:1784583939.395953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.396074:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195712 00000100:00100000:1.0:1784583939.396083:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195712 00000100:00100000:2.0:1784583939.396151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.396157:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784583939.396169:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:2398:x1871271580195712:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583939.396201:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583939.396225:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e480ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3cf expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.396256:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:1.0:1784583939.396259:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583939.396305:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:2398:x1871271580195712:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 139us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.396310:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1784583939.398275:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195584 00000100:00100000:0.0:1784583939.398291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195584 00000100:00100000:0.0:1784583939.398347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00100000:0.0:1784583939.398358:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:11376:x1871271580195584:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583939.398385:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583939.398406:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e480fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3d6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.399444:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.399460:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.399499:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583939.399526:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784583939.399722:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e480fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3d6 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.399750:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3d6 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.399760:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:0.0:1784583939.399763:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784583939.399766:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:0.0:1784583939.399883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:11376:x1871271580195584:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1526us (3732us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1784583939.399891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00100000:2.0:1784583939.417131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.417325:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195840 00000100:00100000:3.0:1784583939.417336:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195840 00000100:00100000:3.0:1784583939.417406:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:3.0:1784583939.417415:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580195840:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:3.0:1784583939.417549:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.417599:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.417610:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583939.417615:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784583939.417620:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.417717:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.417953:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 8 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583939.417988:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1871271599139584:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583939.418166:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784583939.426455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.426641:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580195968 00000100:00100000:0.0:1784583939.426651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580195968 00002000:00100000:0.0:1784583939.426720:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98b303ab1180 x1871271580195968/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:265/0 lens 504/0 e 0 to 0 dl 1784583950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583939.426779:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b303ab1180 with x1871271580195968 ext(0->8) 00010000:00010000:0.0:1784583939.426807:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 9 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.426847:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 9 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583939.426867:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b303ab1180 00000100:00100000:0.0:1784583939.426933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784583939.426944:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2400:x1871271580195968:12345-192.168.203.51@tcp:4:lfs.0 00000100:00100000:3.0:1784583939.428147:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1871271599139584:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583939.428220:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.428885:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:2400:x1871271580195968:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 1932us (2438us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784583939.428906:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00002000:00100000:0.0:1784583939.428917:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98b303ab1180 x1871271580195968/t4294967303(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:265/0 lens 504/448 e 0 to 0 dl 1784583950 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583939.428926:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b303ab1180 with x1871271580195968 ext(0->8) 00010000:00010000:0.0:1784583939.428934:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.428949:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583939.429101:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b303ab1180 00000100:00100000:2.0:1784583939.438605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.439047:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196096 00000100:00100000:0.0:1784583939.439060:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196096 00010000:00010000:0.0:1784583939.439107:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.439208:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:0.0:1784583939.439219:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:2400:x1871271580196096:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583939.439247:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784583939.439275:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784583939.439279:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784583939 00002000:00010000:0.0:1784583939.439281:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784583939 00002000:00010000:0.0:1784583939.439283:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784583939 00002000:00010000:0.0:1784583939.439285:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784583939.439291:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.439321:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.439343:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e480d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c1 expref: 11 pid: 8429 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.439360:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583939.439364:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583939.439370:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.439380:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.439415:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583939.439519:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2400:x1871271580196096:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 300us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583939.439526:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00010000:00010000:3.0:1784583939.439629:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439639:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439657:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439664:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439683:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439690:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583939.439695:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439703:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439718:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.439726:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e4810f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583939.439772:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580195840:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 22358us (22664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.439779:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:3.0:1784583939.447132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.447224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196352 00000100:00100000:0.0:1784583939.447243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196352 00000100:00100000:0.0:1784583939.447308:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:0.0:1784583939.447318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:11376:x1871271580196352:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:0.0:1784583939.447381:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3d6 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583939.447886:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1784583939.447922:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1784583939.448801:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1784583939.448847:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.448864:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.448874:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.448911:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.448925:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 46 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.448939:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599139712:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583939.449083:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583939.454623:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.454864:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196480 00000100:00100000:1.0:1784583939.454873:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196480 00010000:00010000:1.0:1784583939.454911:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 47 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583939.454962:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1784583939.454972:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:2401:x1871271580196480:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583939.454988:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583939.454995:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 47 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.455008:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 47 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.455035:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:1.0:1784583939.455041:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.455064:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.455071:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.455089:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583939.455142:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:2401:x1871271580196480:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 172us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.455150:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00010000:00010000:0.0:1784583939.457170:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e480bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3b3 expref: 46 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583939.457194:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599139712:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583939.457215:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.457251:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.457257:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583939.457358:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1784583939.457459:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1784583939.457607:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599139840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784583939.457659:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583939.457689:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b401665d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583939.457764:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599139840 00000100:00100000:2.0:1784583939.457772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599139840 00000100:00100000:2.0:1784583939.457831:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784583939.457856:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1871271599139840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583939.458012:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1871271599139840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 173us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583939.458020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784583939.460639:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3040d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599139840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784583939.460810:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1784583939.460887:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599139968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784583939.461107:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583939.461145:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784583939.461175:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599139968 00000100:00100000:2.0:1784583939.461183:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599139968 00000100:00100000:2.0:1784583939.461280:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784583939.461291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1871271599139968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583939.461441:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6518:x1871271599139968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (494us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784583939.461449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784583939.461607:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599139968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784583939.461651:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1784583939.461683:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461694:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461701:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461707:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583939.461711:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461742:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461756:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:1.0:1784583939.461759:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784583939.461764:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.461769:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48116 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784583939.461869:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784583939.461926:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1784583939.461937:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382647468981ns, next at 383647466787ns, rc = 0 00000001:00080000:1.0:1784583939.461943:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1784583939.466459:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b43e8a9a00) 00010000:00010000:1.0:1784583939.466487:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784583939.466498:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48101 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3d6 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583939.466755:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:11376:x1871271580196352:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 19439us (19631us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1784583939.466763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000020:00080000:1.0:1784583939.466768:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784583939.469171:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.469350:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196608 00000100:00100000:2.0:1784583939.469373:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196608 00000100:00100000:2.0:1784583939.469441:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 111 00000100:00100000:2.0:1784583939.469451:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:11376:x1871271580196608:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583939.469495:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583939.469520:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4811d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3dd expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.469578:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4811d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3dd expref: 50 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.469613:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4811d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3dd expref: 50 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.469632:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583939.469636:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784583939.469639:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1e00, rc 0) 00000100:00100000:2.0:1784583939.469701:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:11376:x1871271580196608:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 251us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583939.469709:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 111 00000100:00100000:2.0:1784583939.475138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.475185:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196864 00000100:00100000:1.0:1784583939.475194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196864 00000100:00100000:1.0:1784583939.475278:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1784583939.475289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:11376:x1871271580196864:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784583939.475565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:11376:x1871271580196864:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 278us (436us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1784583939.475572:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:0.0:1784583939.558845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.558973:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580196992 00000100:00100000:3.0:1784583939.558982:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580196992 00000100:00100000:3.0:1784583939.559037:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 112 00000100:00100000:3.0:1784583939.559059:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:11386:x1871271580196992:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1784583939.559132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559149:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559162:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559173:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559181:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559187:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559269:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559278:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559284:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583939.559330:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559342:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559354:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559362:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559368:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.559373:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559381:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559393:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.559396:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.559400:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559407:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48124 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559925:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559932:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559939:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559945:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.559958:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559965:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559975:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583939.559977:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.559980:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559986:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4812b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.559996:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560003:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560009:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560014:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.560017:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560023:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560031:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.560033:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.560041:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.560047:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48132 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583939.560171:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:11386:x1871271580196992:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1111us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.560179:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 112 00000100:00100000:3.0:1784583939.644765:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.645074:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580197248 00000100:00100000:2.0:1784583939.645097:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580197248 00000100:00100000:2.0:1784583939.645265:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:2.0:1784583939.645276:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:11389:x1871271580197248:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583939.645312:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583939.645360:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e48139 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3e4 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645563:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645589:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645626:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645651:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645659:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645681:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645871:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4814e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645880:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4814e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.645895:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4814e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583939.645907:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784583939.646038:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646046:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646071:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646078:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583939.646094:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646103:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646128:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583939.646131:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583939.646136:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646155:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48140 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646169:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646187:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646194:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646199:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583939.646202:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646228:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646261:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:2.0:1784583939.646263:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583939.646267:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646272:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e48147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646324:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e48139 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3e4 expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646339:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4814e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3e4 expref: 53 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.646346:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583939.646349:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583939.646351:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0800, rc 0) 00000100:00100000:2.0:1784583939.646460:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11389:x1871271580197248:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1185us (1703us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1784583939.646518:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:2.0:1784583939.654786:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.654973:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580197376 00000100:00100000:3.0:1784583939.654984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580197376 00000100:00100000:3.0:1784583939.655125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:3.0:1784583939.655135:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11389:x1871271580197376:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1784583939.655317:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655358:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655371:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655407:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655415:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655422:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655460:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.655465:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655522:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655548:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.655552:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583939.655557:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.655564:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e4815c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583939.655849:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11389:x1871271580197376:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 700us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.655857:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1784583939.658730:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.658824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580197632 00000100:00100000:2.0:1784583939.658833:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580197632 00000100:00100000:2.0:1784583939.658932:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1784583939.658942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:11389:x1871271580197632:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583939.659408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:11389:x1871271580197632:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 467us (833us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1784583939.659430:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:1.0:1784583939.757936:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599140096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583939.758018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583939.758183:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599140096 00000100:00100000:0.0:1784583939.758190:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599140096 00000100:00100000:0.0:1784583939.758257:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784583939.758265:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599140096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583939.758299:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583939.758348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599140096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583939.758356:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784583939.758889:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599140096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583939.797836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.798013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580197888 00000100:00100000:3.0:1784583939.798023:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580197888 00000100:00100000:3.0:1784583939.798083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:3.0:1784583939.798092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:11399:x1871271580197888:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583939.798117:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.798120:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784583939.798147:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e480de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3c8 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798166:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.798186:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583939.798202:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48163 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798324:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4816a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798337:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4816a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798347:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4816a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583939.798358:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784583939.798820:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48163 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3eb expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798838:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4816a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3eb expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.798847:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.798849:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583939.798852:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583939.798972:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11399:x1871271580197888:12345-192.168.203.51@tcp:101:bash.0 Request processed in 880us (1145us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1784583939.798980:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784583939.816442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.818411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198016 00000100:00100000:3.0:1784583939.818426:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198016 00000100:00100000:1.0:1784583939.818676:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583939.818809:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198144 00000100:00100000:0.0:1784583939.818816:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198144 00000100:00100000:0.0:1784583939.818872:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1784583939.818881:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:2400:x1871271580198144:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583939.818898:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583939.818931:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4816a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3eb expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583939.818949:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:0.0:1784583939.818953:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583939.819012:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:2400:x1871271580198144:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583939.819020:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784583939.819986:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:3.0:1784583939.819999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:11399:x1871271580198016:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583939.820029:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.820046:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48178 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3f2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820080:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820093:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820105:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820208:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48178 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820225:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.820252:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.820255:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583939.820258:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583939.820305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11399:x1871271580198016:12345-192.168.203.51@tcp:101:bash.0 Request processed in 309us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.820311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:1.0:1784583939.828667:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.828755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198400 00000100:00100000:3.0:1784583939.828764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198400 00000100:00100000:3.0:1784583939.828824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:3.0:1784583939.828834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:11399:x1871271580198400:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1784583939.828910:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583939.828935:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4814e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3e4 expref: 55 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.828954:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.828959:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583939.829130:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.829144:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.829155:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583939.829198:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:3.0:1784583939.829220:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059caf037 reply state 00000000cf743830 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.829244:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.829252:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.829255:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583939.829258:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583939.829358:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:11399:x1871271580198400:12345-192.168.203.51@tcp:36:bash.0 Request processed in 525us (701us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1784583939.829366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000020:00080000:3.0:1784583939.829371:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784583939.834633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.834716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198528 00000100:00100000:3.0:1784583939.834738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198528 00000100:00100000:3.0:1784583939.834799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:3.0:1784583939.834808:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:11399:x1871271580198528:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583939.834833:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.834854:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4818d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee3f9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.834958:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.834973:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.834983:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583939.835014:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784583939.835018:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583939.835037:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.835060:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4818d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.835077:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.835086:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.835089:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583939.835092:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583939.835156:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:11399:x1871271580198528:12345-192.168.203.51@tcp:101:bash.0 Request processed in 349us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.835164:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:1.0:1784583939.843151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.843306:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198784 00000100:00100000:2.0:1784583939.843317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198784 00000100:00100000:2.0:1784583939.843375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:2.0:1784583939.843386:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:11399:x1871271580198784:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1784583939.843639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11399:x1871271580198784:12345-192.168.203.51@tcp:35:bash.0 Request processed in 254us (497us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1784583939.843647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1784583939.890768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.890842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580198912 00000100:00100000:3.0:1784583939.890851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580198912 00000100:00100000:3.0:1784583939.890983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:3.0:1784583939.890993:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:11405:x1871271580198912:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583939.891018:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.891038:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4819b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee400 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891105:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891119:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891131:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583939.891177:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784583939.891181:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583939.891201:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891224:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4819b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee400 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891253:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee400 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.891281:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.891285:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583939.891288:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983600, rc 0) 00000100:00100000:3.0:1784583939.891349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580198912:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 358us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.891356:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:0.0:1784583939.896830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.896941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199040 00000100:00100000:3.0:1784583939.896950:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199040 00000100:00100000:3.0:1784583939.897008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1784583939.897019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580199040:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583939.897040:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.897062:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e481a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee407 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897147:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897162:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897173:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897185:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897193:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897214:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897306:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897314:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897321:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583939.897360:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784583939.897365:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583939.897383:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897396:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897404:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897422:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897428:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897434:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.897438:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897452:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897465:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583939.897501:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.897505:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897513:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e481b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897530:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897536:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897542:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897547:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216aa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583939.897550:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897555:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897562:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583939.897565:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583939.897567:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897582:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897609:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e481a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee407 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897622:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee407 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.897630:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.897632:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583939.897634:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a400, rc 0) 00000100:00100000:3.0:1784583939.898071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11405:x1871271580199040:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1052us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.898079:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:1.0:1784583939.904149:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.904820:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199296 00000100:00100000:2.0:1784583939.904831:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199296 00000100:00100000:0.0:1784583939.906363:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.906746:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199424 00000100:00100000:1.0:1784583939.906755:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199424 00000100:00100000:1.0:1784583939.906824:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1784583939.906835:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:2400:x1871271580199424:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583939.906852:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583939.906877:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e481be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee407 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.907171:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:1.0:1784583939.907178:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583939.907250:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:2400:x1871271580199424:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 416us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.907258:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784583939.907792:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:2.0:1784583939.907805:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580199296:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583939.907824:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583939.907840:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee40e expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.907947:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.907961:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.907971:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.908011:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.908023:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 61 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583939.908035:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599140224:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583939.908112:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:0.0:1784583939.915114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583939.915261:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199552 00000100:00100000:1.0:1784583939.915269:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199552 00010000:00010000:1.0:1784583939.915308:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 62 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583939.915348:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784583939.915358:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:2400:x1871271580199552:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583939.915373:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583939.915391:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 62 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.915404:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 62 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.915435:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:1.0:1784583939.915441:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.915452:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.915460:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583939.915511:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583939.915564:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:2400:x1871271580199552:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 207us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583939.915572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00010000:00010000:2.0:1784583939.916173:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48194 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f9 expref: 61 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583939.916190:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599140224:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583939.916209:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.916218:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.916224:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583939.916297:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784583939.916998:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 62 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.917016:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 61 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.917044:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583939.917047:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784583939.917049:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1a00, rc 0) 00000100:00100000:2.0:1784583939.917092:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11405:x1871271580199296:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 9290us (12953us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1784583939.917100:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:0.0:1784583939.921129:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.921209:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199808 00000100:00100000:3.0:1784583939.921219:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199808 00000100:00100000:3.0:1784583939.921301:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1784583939.921312:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11405:x1871271580199808:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:3.0:1784583939.921328:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583939.921352:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4811d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3dd expref: 61 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.921371:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.921720:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583939.921877:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580199808:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 565us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583939.921906:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784583939.924999:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583939.925089:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580199936 00000100:00100000:2.0:1784583939.925099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580199936 00000100:00100000:2.0:1784583939.925184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:2.0:1784583939.925194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580199936:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:2.0:1784583939.925690:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.925706:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583939.925717:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784583939.925875:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784583939.926061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580199936:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 866us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583939.926070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:0.0:1784583939.929133:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583939.929386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200064 00000100:00100000:3.0:1784583939.929397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200064 00000100:00100000:3.0:1784583939.929456:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1784583939.929700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:11405:x1871271580200064:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583939.929722:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583939.929810:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee415 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.929867:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.929878:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.930073:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.930091:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.930104:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583939.930107:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583939.930111:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583939.930119:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216aa00, rc 0) 00000100:00100000:2.0:1784583939.930281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11405:x1871271580200064:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 814us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583939.930289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000040:00080000:3.0:1784583940.205678:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583940.205688:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784583940.205833:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1784583940.205844:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784583940.205983:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599140352:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784583940.206149:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784583940.218319:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.218677:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599140352:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784583940.220323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200192 00000100:00100000:1.0:1784583940.220353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200192 00000100:00100000:1.0:1784583940.220418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:1.0:1784583940.220428:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11406:x1871271580200192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784583940.220462:0:6516:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784583940.220601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11406:x1871271580200192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 173us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583940.220609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:0.0:1784583940.228922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.229259:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200320 00000100:00100000:2.0:1784583940.229285:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200320 00000100:00100000:2.0:1784583940.229394:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:2.0:1784583940.229404:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11406:x1871271580200320:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.229533:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229549:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229560:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229574:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229590:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229596:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229617:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229626:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229632:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583940.229686:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784583940.229691:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583940.229710:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229721:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229727:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229744:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229751:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583940.229755:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229762:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229775:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:2.0:1784583940.229777:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583940.229782:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229789:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e481e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229802:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229808:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229814:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229824:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583940.229827:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229833:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229840:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff98b4092c0b00) 00010000:00010000:2.0:1784583940.229842:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583940.229844:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229849:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e481ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229862:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229868:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229883:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229888:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583940.229891:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229897:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229915:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583940.229918:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583940.229921:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.229927:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e481f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.230002:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11406:x1871271580200320:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 599us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.230010:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:3.0:1784583940.233371:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.233613:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200576 00000100:00100000:1.0:1784583940.233623:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200576 00000100:00100000:1.0:1784583940.233679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:1.0:1784583940.233689:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:11406:x1871271580200576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583940.233708:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583940.233905:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e481fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee41c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234239:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234254:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234265:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583940.234274:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784583940.234351:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234361:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234601:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234608:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cee00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583940.234611:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234619:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234632:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:1.0:1784583940.234634:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784583940.234639:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234646:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234691:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e481fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee41c expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234701:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:1.0:1784583940.234704:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784583940.234707:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e481fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee41c expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.234729:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:1.0:1784583940.234952:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580200576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1263us (1589us total) trans 4294967400 rc 301/301 00000100:00100000:1.0:1784583940.234970:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:0.0:1784583940.240100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.241158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200704 00000100:00100000:1.0:1784583940.241169:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200704 00000100:00100000:1.0:1784583940.241262:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:1.0:1784583940.241287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580200704:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784583940.241362:0:6514:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784583940.241595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580200704:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 323us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583940.241603:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:3.0:1784583940.250424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.251421:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580200960 00000100:00100000:2.0:1784583940.251440:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580200960 00000100:00100000:2.0:1784583940.251523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:2.0:1784583940.251534:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580200960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.251555:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583940.251558:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784583940.251595:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e481a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee400 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.251617:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:2.0:1784583940.251622:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583940.251638:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48212 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee423 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784583940.255064:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1784583940.255350:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.255380:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.255393:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.258268:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48212 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee423 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.258299:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee423 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.258309:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b4092c0b00) 00010000:00010000:2.0:1784583940.258313:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583940.258317:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0400, rc 0) 00000100:00100000:2.0:1784583940.258396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:11406:x1871271580200960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 6863us (7979us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784583940.258405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 128 00010000:00010000:1.0:1784583940.272150:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583940.273341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.273431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580201216 00000100:00100000:1.0:1784583940.273441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580201216 00000100:00100000:1.0:1784583940.273533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:1.0:1784583940.273544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:11406:x1871271580201216:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784583940.273610:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583940.273635:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee423 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273663:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b4092c0b00) 00010000:00010000:1.0:1784583940.273674:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583940.273694:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273708:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273717:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273783:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273792:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.273798:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274028:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274036:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274043:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274049:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cea00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583940.274053:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274060:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274069:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:1.0:1784583940.274072:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583940.274076:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274082:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48227 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274100:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274106:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274111:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274115:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cee00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583940.274118:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274123:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274131:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8a0ce441 (ffff98b30397a800) 00010000:00010000:1.0:1784583940.274133:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583940.274136:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.274141:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e4822e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8a0ce441 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.274237:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580201216:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 685us (893us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784583940.274246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:1.0:1784583940.305162:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.305837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580201344 00000100:00100000:3.0:1784583940.305848:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580201344 00000100:00100000:3.0:1784583940.306260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:3.0:1784583940.306273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:11406:x1871271580201344:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583940.306294:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583940.306318:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48235 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee42a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.306352:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.306366:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.306379:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.307646:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.309107:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.309119:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:3.0:1784583940.309123:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583940.309126:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a600, rc 0) 00000100:00100000:3.0:1784583940.309207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:11406:x1871271580201344:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2936us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583940.309217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:3.0:1784583940.312770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.312895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580201600 00000100:00100000:1.0:1784583940.312906:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580201600 00000100:00100000:1.0:1784583940.312980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:1.0:1784583940.312989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:11406:x1871271580201600:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784583940.313079:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.313092:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.313101:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784583940.313253:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1784583940.313263:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383498794816ns, next at 384498792258ns, rc = 0 00000004:00010000:1.0:1784583940.313311:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000344fd091 reply state 0000000078faa9ec transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.313325:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.313332:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:1.0:1784583940.313335:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784583940.313339:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784583940.313446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:11406:x1871271580201600:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 457us (685us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1784583940.313454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:0.0:1784583940.316096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.316156:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580201728 00000100:00100000:2.0:1784583940.316167:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580201728 00000100:00100000:2.0:1784583940.316301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:2.0:1784583940.316313:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:11406:x1871271580201728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.316338:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583940.316360:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee431 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.317813:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.317849:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.317870:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:2.0:1784583940.317873:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784583940.317877:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1400, rc 0) 00000100:00100000:2.0:1784583940.317997:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11406:x1871271580201728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1685us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.318007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:3.0:1784583940.323782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.323950:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580201856 00000100:00100000:2.0:1784583940.323961:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580201856 00000100:00100000:2.0:1784583940.324071:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1784583940.324081:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580201856:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784583940.324317:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580201856:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 237us (547us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784583940.324326:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00080000:3.0:1784583940.324676:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583940.329722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.329804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580202112 00000100:00100000:2.0:1784583940.329822:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580202112 00000100:00100000:2.0:1784583940.329874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1784583940.329883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:11406:x1871271580202112:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784583940.330178:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11406:x1871271580202112:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 295us (463us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1784583940.330187:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:1.0:1784583940.334769:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.334916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580202368 00000100:00100000:2.0:1784583940.334937:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580202368 00000100:00100000:2.0:1784583940.335005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:2.0:1784583940.335017:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11406:x1871271580202368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784583940.335131:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11406:x1871271580202368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.335139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:3.0:1784583940.338837:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.339149:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580202496 00000100:00100000:2.0:1784583940.339157:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580202496 00000100:00100000:2.0:1784583940.339205:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:2.0:1784583940.339212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:11406:x1871271580202496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.339238:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583940.339260:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e48251 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee438 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339327:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339349:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339361:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583940.339416:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583940.339438:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339464:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e48251 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee438 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339544:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee438 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.339552:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:2.0:1784583940.339555:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784583940.339558:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1800, rc 0) 00000100:00100000:2.0:1784583940.339630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:11406:x1871271580202496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 418us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.339638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:0.0:1784583940.342291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.342393:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580202624 00000100:00100000:2.0:1784583940.342406:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580202624 00000100:00100000:2.0:1784583940.342495:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1784583940.342505:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2399:x1871271580202624:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.342531:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583940.342554:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee43f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784583940.342579:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9704, blocks: 0x0 00010000:00010000:2.0:1784583940.342598:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1784583940.342603:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583940.342614:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.342630:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.342667:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1000, rc 0) 00000100:00100000:2.0:1784583940.342786:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2399:x1871271580202624:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.342794:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:1.0:1784583940.349791:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.350041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580202880 00000100:00100000:2.0:1784583940.350052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580202880 00000100:00100000:2.0:1784583940.350116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:2.0:1784583940.350127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:11406:x1871271580202880:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784583940.350255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:11406:x1871271580202880:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 130us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.350263:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:3.0:1784583940.358435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.358575:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203008 00000100:00100000:2.0:1784583940.358586:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203008 00000100:00100000:2.0:1784583940.358647:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:2.0:1784583940.358658:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:11406:x1871271580203008:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.358676:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583940.358694:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee446 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.358727:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.358840:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583940.358845:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583940.358862:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.358901:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.358946:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 11 pid: 8429 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.358962:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599140480:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583940.359053:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784583940.363391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.363608:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203136 00000100:00100000:1.0:1784583940.363617:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203136 00010000:00010000:1.0:1784583940.363658:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 12 pid: 8429 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.363719:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:1.0:1784583940.363728:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2400:x1871271580203136:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583940.363752:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583940.363774:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 12 pid: 8429 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.363787:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 12 pid: 8429 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.363809:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583940.363814:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583940.363822:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.363837:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.363873:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.363887:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6501:1871271599140608:192.168.203.51@tcp:105: 00000100:00100000:1.0:1784583940.363981:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b401665d80 going to sleep for 11 seconds 00010000:00010000:2.0:1784583940.364875:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e4825f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee43f expref: 12 pid: 8429 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.364892:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599140480:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583940.364914:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.364924:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1600, rc 0) 00000100:00100000:2.0:1784583940.364966:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:11406:x1871271580203008:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 6311us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.364973:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1784583940.367972:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6501:1871271599140608:192.168.203.51@tcp:105: 00010000:00010000:1.0:1784583940.368014:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583940.368072:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2400:x1871271580203136:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4344us (4697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583940.368082:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:1.0:1784583940.371682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583940.371816:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203264 00000100:00100000:0.0:1784583940.371825:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203264 00002000:00100000:0.0:1784583940.371876:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98b303961c00 x1871271580203264/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:266/0 lens 504/0 e 0 to 0 dl 1784583951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583940.371887:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b303961c00 with x1871271580203264 ext(0->12) 00002000:00010000:0.0:1784583940.371904:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b303961c00 00000100:00100000:0.0:1784583940.371938:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1784583940.371947:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2400:x1871271580203264:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784583940.376243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2400:x1871271580203264:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 4276us (4549us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784583940.376258:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00002000:00100000:0.0:1784583940.376271:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98b303961c00 x1871271580203264/t4294967309(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:266/0 lens 504/448 e 0 to 0 dl 1784583951 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583940.376281:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b303961c00 with x1871271580203264 ext(0->12) 00002000:00010000:0.0:1784583940.376288:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b303961c00 00000100:00100000:3.0:1784583940.378768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.378894:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203392 00000100:00100000:2.0:1784583940.378904:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203392 00000100:00100000:2.0:1784583940.378961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:2.0:1784583940.378972:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:11406:x1871271580203392:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784583940.380657:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1784583940.380672:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1784583940.380757:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1784583940.380780:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b30401e6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1784583940.380786:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b4376bad00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b30401e480 00000020:00080000:1.0:1784583940.380789:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b4376ba600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b41805aa00 00000004:00080000:1.0:1784583940.380820:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1784583940.380865:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380877:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380885:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380891:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.380896:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380916:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380933:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583940.380936:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.380941:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380947:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e47f6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380976:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380983:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380988:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.380994:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.380996:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381002:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381010:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98b43e8a9400) 00010000:00010000:3.0:1784583940.381012:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.381015:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381032:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48013 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381049:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381056:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381062:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381067:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.381070:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381077:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381085:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583940.381087:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.381091:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381096:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48091 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381107:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381113:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381126:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381132:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.381135:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381142:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381151:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583940.381153:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.381156:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381163:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e480b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381179:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381185:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381190:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381196:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.381199:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381216:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381226:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583940.381241:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.381245:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381251:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48186 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381263:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381269:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381275:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381280:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cee00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.381283:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381289:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381297:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:3.0:1784583940.381299:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784583940.381302:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.381318:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48243 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.381489:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784583940.381507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599140736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784583940.381571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583940.381631:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599140736 00000100:00100000:0.0:1784583940.381638:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599140736 00000100:00100000:0.0:1784583940.381691:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784583940.381700:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1871271599140736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784583940.381725:0:8805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1784583940.381754:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a5e9703, atime: 0x6a5e9703, ctime: 0x6a5e9703, blocks: 0x8 00010000:00010000:0.0:1784583940.381761:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.381777:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1784583940.381781:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583940.381788:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.381813:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.381822:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.381828:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.381846:0:8805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784583940.381981:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3639:x1871271599140736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 282us (409us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784583940.381988:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1784583940.382008:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583940.382014:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382022:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583940.382026:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382034:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382047:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382061:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e4826d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382077:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.382079:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.382080:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784583940.382107:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b4049b8380/2, rc 0, transno 4294967305 00000100:00100000:0.0:1784583940.382113:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599140736:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1784583940.382125:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1784583940.382514:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1784583940.382566:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599140864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784583940.382612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583940.382715:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599140864 00000100:00100000:0.0:1784583940.382720:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599140864 00000100:00100000:0.0:1784583940.382767:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784583940.382774:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599140864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784583940.382789:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1784583940.382805:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382821:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382828:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784583940.382831:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583940.382835:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382871:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.382885:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 11 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.382897:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599141120:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583940.382957:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42030ff00 going to sleep for 11 seconds 00000100:00080000:0.0:1784583940.382968:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1784583940.383150:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b303af7900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1784583940.383155:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea50a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b303af7b40 00000020:00080000:1.0:1784583940.383158:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea50300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b30299fc00 00000020:00080000:1.0:1784583940.383182:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1784583940.383581:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1784583940.383638:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1784583940.385528:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784583940.385546:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784583940.385823:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11406:x1871271580203392:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 6848us (7056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.385834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:3.0:1784583940.386108:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583940.386165:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599140992 00000100:00100000:3.0:1784583940.386172:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599140992 00000100:00100000:3.0:1784583940.386212:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784583940.386221:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599140992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784583940.386342:0:11860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784583940.386346:0:11860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784583940 00002000:00010000:3.0:1784583940.386348:0:11860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784583940.386351:0:11860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784583940 -> 1784583940 00002000:00010000:3.0:1784583940.386353:0:11860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784583940.386386:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3641:x1871271599140992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (279us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784583940.386392:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1784583940.386445:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43769ad80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1784583940.386450:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784583940.386838:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599141120:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583940.386861:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.388346:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.388884:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203520 00000100:00100000:2.0:1784583940.388893:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203520 00000100:00100000:3.0:1784583940.388917:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:2.0:1784583940.388927:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 12 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.388973:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:0.0:1784583940.388973:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203648 00000100:00100000:0.0:1784583940.388977:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203648 00000100:00100000:2.0:1784583940.388982:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2400:x1871271580203520:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583940.388996:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583940.389002:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 13 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.389010:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00010000:00010000:2.0:1784583940.389015:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 13 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.389017:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2401:x1871271580203648:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.389037:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3def5b1/0xdab2421a42e48021 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee39e expref: 13 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389052:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583940.389056:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583940.389062:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389072:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389094:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583940.389147:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2400:x1871271580203520:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 166us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.389154:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00010000:00010000:2.0:1784583940.389201:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389211:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389220:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389243:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.389268:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784583940.389356:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583940.389361:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.389372:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583940.389375:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.389381:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.389389:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.389393:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001882ffc/0xdab2421a42e48274 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.389405:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.389406:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.389407:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583940.391321:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1871271599140864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8542us (8702us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784583940.391332:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:0.0:1784583940.391889:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1784583940.391899:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000004:00080000:3.0:1784583940.391965:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43766f480/2, rc 0, transno 4294967311 00000100:00100000:3.0:1784583940.391973:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599140864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784583940.392116:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580203648:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 3096us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.392124:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1784583940.394301:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.394351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580203904 00000100:00100000:2.0:1784583940.394360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580203904 00000100:00100000:2.0:1784583940.394502:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:2.0:1784583940.394513:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11406:x1871271580203904:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.394572:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583940.394635:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48258 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee438 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.394652:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:2.0:1784583940.394656:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784583940.394682:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.394695:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.394703:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583940.394928:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053e73600 reply state 000000005f74c678 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.394945:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.394950:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:2.0:1784583940.394952:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784583940.394954:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784583940.395098:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:11406:x1871271580203904:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 586us (803us total) trans 4294967404 rc 0/0 00000100:00100000:2.0:1784583940.395106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:1.0:1784583940.397272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.397386:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204032 00000100:00100000:3.0:1784583940.397395:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204032 00000100:00100000:3.0:1784583940.397459:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1784583940.397505:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580204032:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784583940.397642:0:8805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1784583940.397646:0:8805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1784583940 -> 1784583940 00002000:00010000:3.0:1784583940.397648:0:8805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784583939 00002000:00010000:3.0:1784583940.397650:0:8805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784583940 -> 1784583940 00002000:00010000:3.0:1784583940.397653:0:8805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1784583940.397726:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2399:x1871271580204032:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 249us (451us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1784583940.397734:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1784583940.400143:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.400269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204288 00000100:00100000:3.0:1784583940.400277:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204288 00000100:00100000:3.0:1784583940.400369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:3.0:1784583940.400380:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:11406:x1871271580204288:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784583940.400441:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.400454:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.400461:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.400513:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.400542:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 17 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.400556:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599141248:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583940.400641:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583940.402546:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599141248:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583940.402574:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.404314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583940.404799:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204416 00000100:00100000:0.0:1784583940.404808:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204416 00010000:00010000:0.0:1784583940.404848:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 18 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.405017:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:0.0:1784583940.405028:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2401:x1871271580204416:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583940.405060:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583940.405067:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 18 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405081:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 18 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405104:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4823c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee42a expref: 18 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405127:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:0.0:1784583940.405132:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405142:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405149:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.405180:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583940.405250:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:2401:x1871271580204416:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 224us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.405259:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00010000:00010000:3.0:1784583940.405440:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405448:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405513:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405520:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405527:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405532:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.405536:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405543:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405562:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:3.0:1784583940.405564:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784583940.405568:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.405580:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48282 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.405626:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11406:x1871271580204288:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 5247us (5490us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784583940.405634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:1.0:1784583940.407984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.408031:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204544 00000100:00100000:3.0:1784583940.408041:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204544 00000100:00100000:3.0:1784583940.408087:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1784583940.408097:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580204544:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784583940.408150:0:11860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.408169:0:11860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.408178:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583940.408183:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784583940.408187:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.408222:0:11860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.408263:0:11860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 7 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.408278:0:11860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11860:1871271599141376:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583940.408358:0:11860:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784583940.412101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.412168:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204672 00000100:00100000:2.0:1784583940.412175:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204672 00010000:00010000:2.0:1784583940.412206:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 8 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.412288:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1784583940.412298:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580204672:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583940.412312:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583940.412334:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 8 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.412352:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 8 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.412370:0:11860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11860:1871271599141376:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583940.412374:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee446 expref: 8 pid: 8428 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.412388:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583940.412392:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583940.412397:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.412538:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412553:0:11860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.412560:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583940.412564:0:11860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412570:0:11860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412587:0:11860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412596:0:11860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412604:0:11860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.412611:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580204672:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 315us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.412619:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00010000:00010000:3.0:1784583940.412623:0:11860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583940.412627:0:11860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412636:0:11860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412658:0:11860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.412668:0:11860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a776e1b/0xdab2421a42e48289 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.412739:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580204544:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 4643us (4760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583940.412748:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:1.0:1784583940.414591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.414624:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580204928 00000100:00100000:2.0:1784583940.414632:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580204928 00000100:00100000:2.0:1784583940.414680:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:2.0:1784583940.414691:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:11406:x1871271580204928:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784583940.414848:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.414866:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.414873:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.414906:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.414916:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 16 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.414926:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30419dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599141504:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583940.415249:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:2.0:1784583940.417681:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583940.417880:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30419dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599141504:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583940.417954:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205056 00010000:00010000:1.0:1784583940.417960:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.417962:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205056 00010000:00010000:0.0:1784583940.417999:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 17 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.418049:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:0.0:1784583940.418058:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:2401:x1871271580205056:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583940.418083:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583940.418091:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 17 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418104:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 17 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418125:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4817f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee3f2 expref: 17 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418140:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:0.0:1784583940.418146:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418155:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418163:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418171:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.418195:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583940.418223:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.418244:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583940.418256:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:2401:x1871271580205056:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 198us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.418269:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00010000:00010000:1.0:1784583940.418397:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.418409:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.418418:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.418444:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.418457:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 16 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.418837:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599141632:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583940.418934:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b420c0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784583940.423930:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583940.423975:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205184 00000100:00100000:0.0:1784583940.423983:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205184 00010000:00010000:0.0:1784583940.424024:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 17 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.424042:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599141632:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583940.424059:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:0.0:1784583940.424067:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:2400:x1871271580205184:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583940.424068:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424080:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583940.424087:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 17 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424097:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 17 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424114:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4824a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee431 expref: 17 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424124:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:0.0:1784583940.424128:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424134:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424139:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.424171:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583940.424210:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:2400:x1871271580205184:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 145us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.424217:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 76 00010000:00010000:1.0:1784583940.424238:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.424253:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784583940.424361:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1784583940.424505:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1784583940.424542:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1784583940.424625:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599141760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784583940.424666:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583940.424700:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b406747240 going to sleep for 11 seconds 00000100:00100000:0.0:1784583940.425268:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599141760 00000100:00100000:0.0:1784583940.425274:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599141760 00000100:00100000:0.0:1784583940.425313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784583940.425322:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9809:x1871271599141760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784583940.425403:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9809:x1871271599141760:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.425411:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784583940.425512:0:9809:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1784583940.425518:0:9809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1784583940.425533:0:9809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43769ad80, transno 4294967310 00000100:00100000:2.0:1784583940.425548:0:9809:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98b43766f480 x1871271599140864/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784583956 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583940.425587:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599141760:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1784583940.425688:0:9809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1784583940.425735:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599141888:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784583940.425765:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583940.425791:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32900 going to sleep for 11 seconds 00000100:00100000:1.0:1784583940.426030:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599141888 00000100:00100000:1.0:1784583940.426035:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599141888 00000100:00100000:1.0:1784583940.426056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784583940.426063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9809:x1871271599141888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784583940.426160:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9809:x1871271599141888:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (395us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784583940.426167:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784583940.426285:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9809:1871271599141888:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784583940.426315:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426325:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426332:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426351:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.426356:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426365:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426379:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:3.0:1784583940.426382:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583940.426386:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426392:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48297 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426414:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426420:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426425:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426430:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.426432:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426437:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426455:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583940.426457:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583940.426463:0:9809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426501:0:9809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426510:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.426533:0:9809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.426544:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599142016:192.168.203.51@tcp:105: 00000100:00100000:3.0:1784583940.426608:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583940.432061:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599142016:192.168.203.51@tcp:105: 00010000:00010000:3.0:1784583940.432092:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432103:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e481da lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432135:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.432141:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1784583940.432149:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432174:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432185:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432191:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583940.432350:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205312 00000100:00100000:1.0:1784583940.432357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205312 00000100:00100000:1.0:1784583940.432410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:1.0:1784583940.432419:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11405:x1871271580205312:12345-192.168.203.51@tcp:49:lfs.0 00000100:00100000:1.0:1784583940.432570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11405:x1871271580205312:12345-192.168.203.51@tcp:49:lfs.0 Request processed in 151us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583940.432578:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00010000:00010000:3.0:1784583940.432803:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432810:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.432814:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432821:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432833:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583940.432836:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.432840:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432845:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4829e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432858:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432864:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432877:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432882:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.432885:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432891:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432900:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583940.432903:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583940.432905:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.432911:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48290 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784583940.433100:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583940.433105:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1784583940.434598:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:11406:x1871271580204928:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 19902us (20005us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784583940.434612:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 139 00000020:00080000:2.0:1784583940.434618:0:9809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784583940.435098:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784583940.435111:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784583940.437209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.437302:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583940.438162:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205568 00000100:00100000:0.0:1784583940.438173:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205568 00000100:00100000:0.0:1784583940.438458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:0.0:1784583940.438503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:11405:x1871271580205568:12345-192.168.203.51@tcp:58:lfs.0 00000100:00100000:1.0:1784583940.438672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205824 00000100:00100000:1.0:1784583940.438677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205824 00000100:00100000:1.0:1784583940.438702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:1.0:1784583940.438709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:11406:x1871271580205824:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1784583940.438791:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1784583940.438876:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:11405:x1871271580205568:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 409us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583940.438883:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 140 00000004:00080000:1.0:1784583940.438902:0:6517:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784583940.438936:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:1.0:1784583940.438970:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.438995:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.439015:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.439024:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.439031:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.439037:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583940.439062:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784583940.439122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:11406:x1871271580205824:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 412us (1818us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784583940.439130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000020:00080000:1.0:1784583940.439134:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784583940.439610:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583940.439617:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.439625:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583940.439629:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.439649:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.439661:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:0.0:1784583940.439664:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784583940.439669:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.439675:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e482a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583940.439686:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.439688:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583940.439690:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583940.456926:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583940.457289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580205952 00000100:00100000:3.0:1784583940.457298:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580205952 00000100:00100000:3.0:1784583940.457358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:3.0:1784583940.457368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:11408:x1871271580205952:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583940.457391:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583940.457410:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e482ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee44d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457524:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457539:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457550:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457565:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457572:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457579:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457644:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457654:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 22 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457662:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457695:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 22 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.457720:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 22 pid: 9809 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583940.457733:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599142144:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583940.459192:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583940.463911:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599142144:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583940.463912:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:1.0:1784583940.463942:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.464146:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206208 00000100:00100000:2.0:1784583940.464153:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206208 00000100:00100000:2.0:1784583940.464209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1784583940.464219:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:6168:x1871271580206208:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784583940.464439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:6168:x1871271580206208:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 221us (535us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1784583940.464447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:0.0:1784583940.466184:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583940.466282:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206336 00000100:00100000:2.0:1784583940.466292:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206336 00010000:00010000:2.0:1784583940.466329:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 24 pid: 9809 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583940.467063:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:2.0:1784583940.467090:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:2400:x1871271580206336:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583940.467116:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583940.467129:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 24 pid: 9809 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467146:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 24 pid: 9809 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467168:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e481cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee40e expref: 24 pid: 9809 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467183:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583940.467188:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467203:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467211:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583940.467249:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583940.467307:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:2400:x1871271580206336:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 219us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583940.467317:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00010000:00010000:3.0:1784583940.467322:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467334:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583940.467566:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784583940.467570:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583940.467591:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467614:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467621:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467628:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467634:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.467644:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467653:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467663:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583940.467666:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.467669:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467676:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467688:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467694:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467700:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467705:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583940.467708:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467714:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467720:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98b43e8a9200) 00010000:00010000:3.0:1784583940.467722:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583940.467729:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467735:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467769:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e482ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee44d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467783:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee44d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583940.467790:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583940.467793:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583940.467795:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a400, rc 0) 00000100:00100000:3.0:1784583940.467823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11408:x1871271580205952:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 10457us (10907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583940.467830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:3.0:1784583941.206976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207053:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207075:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207115:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.207146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206592 00000100:00100000:3.0:1784583941.207155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206592 00000100:00100000:3.0:1784583941.207217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206720 00000100:00100000:3.0:1784583941.207220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206720 00000100:00100000:3.0:1784583941.207248:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580207232 00000100:00100000:3.0:1784583941.207251:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580207232 00000100:00100000:3.0:1784583941.207277:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 272 00000100:00100000:3.0:1784583941.207285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2398:x1871271580206592:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207358:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2398:x1871271580206592:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 73us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 272 00000100:00100000:3.0:1784583941.207383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 273 00000100:00100000:3.0:1784583941.207389:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580206720:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580206720:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 273 00000100:00100000:3.0:1784583941.207447:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 274 00000100:00100000:3.0:1784583941.207452:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580207232:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207492:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580207232:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 39us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207498:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 274 00000100:00100000:3.0:1784583941.207516:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206848 00000100:00100000:3.0:1784583941.207519:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206848 00000100:00100000:3.0:1784583941.207540:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206976 00000100:00100000:3.0:1784583941.207542:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206976 00000100:00100000:3.0:1784583941.207562:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1784583941.207567:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580206848:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207592:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580206848:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207598:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1784583941.207609:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:3.0:1784583941.207632:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2399:x1871271580206976:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207654:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2399:x1871271580206976:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207661:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:3.0:1784583941.207677:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580206464 00000100:00100000:3.0:1784583941.207681:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580206464 00000100:00100000:3.0:1784583941.207704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 375 00000100:00100000:3.0:1784583941.207711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580206464:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.207748:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580206464:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 37us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.207754:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 375 00000100:00080000:3.0:1784583941.207786:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583941.207791:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583941.207793:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583941.214794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.215005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580207104 00000100:00100000:3.0:1784583941.215014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580207104 00000100:00100000:3.0:1784583941.215142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 275 00000100:00100000:3.0:1784583941.215154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580207104:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583941.215231:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580207104:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.215239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 275 00000100:00080000:1.0:1784583941.217175:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583941.298191:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599142272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583941.298294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.298365:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142272 00000100:00100000:0.0:1784583941.298372:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142272 00000100:00100000:0.0:1784583941.298424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784583941.298432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599142272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784583941.298461:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583941.298550:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599142272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.298557:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1784583941.301684:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583941.302324:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599142656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784583941.302382:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.302431:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599143168:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.302455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.302490:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599143680:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.302513:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.302530:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599144192:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.302550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.302815:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599142528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583941.302844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.302876:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599143040:0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.303012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.303123:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599143552:0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.303150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.303168:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599144064:0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.303188:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.303235:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143168 00000100:00100000:3.0:1784583941.303242:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143168 00000100:00100000:3.0:1784583941.303280:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143552 00000100:00100000:3.0:1784583941.303284:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143552 00000100:00100000:3.0:1784583941.303306:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144064 00000100:00100000:3.0:1784583941.303309:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144064 00000100:00100000:3.0:1784583941.303328:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784583941.303335:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599143168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.303378:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599143168:12345-0@lo:400:kworker.0 Request processed in 43us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.303385:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784583941.303681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143040 00000100:00100000:1.0:1784583941.303686:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143040 00000100:00100000:1.0:1784583941.303716:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784583941.303723:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599143040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.304720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599143040:12345-0@lo:400:kworker.0 Request processed in 995us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583941.305151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784583941.305206:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599143040:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.305679:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599143168:0@lo:400:kworker.0 00010000:00010000:0.0:1784583941.305708:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583941.305721:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142656 00000100:00100000:0.0:1784583941.306107:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142656 00000100:00100000:0.0:1784583941.306152:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142528 00000100:00100000:0.0:1784583941.306156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142528 00000100:00100000:0.0:1784583941.306174:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784583941.306181:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599142656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784583941.306200:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784583941.306258:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599142656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.306264:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784583941.306277:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784583941.306283:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599142528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583941.306292:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784583941.306324:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599142528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.306329:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784583941.306347:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143680 00000100:00100000:0.0:1784583941.306351:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143680 00000100:00100000:0.0:1784583941.306382:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144192 00000100:00100000:0.0:1784583941.306385:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144192 00000100:00100000:0.0:1784583941.306403:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784583941.306409:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599143680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.306439:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599143680:12345-0@lo:400:kworker.0 Request processed in 30us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.306445:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784583941.306456:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784583941.306461:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3642:x1871271599144192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.306505:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3642:x1871271599144192:12345-0@lo:400:kworker.0 Request processed in 44us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.306511:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1784583941.306529:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583941.306533:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583941.306563:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599142656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583941.306838:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784583941.306848:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599143552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.306884:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599143552:12345-0@lo:400:kworker.0 Request processed in 38us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.306952:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784583941.306968:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784583941.306975:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599144064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583941.307006:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599144064:12345-0@lo:400:kworker.0 Request processed in 32us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.307012:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784583941.308859:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599143680:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.309680:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599144192:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310157:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599142400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583941.310214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310273:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599142912:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310322:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599143424:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310362:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599143936:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310416:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784583941.310422:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599142784:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310490:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599143296:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583941.310534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599143808:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.310554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583941.310983:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142400 00000100:00100000:3.0:1784583941.310990:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142400 00000100:00100000:1.0:1784583941.312255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142912 00000100:00100000:1.0:1784583941.312266:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142912 00000100:00100000:1.0:1784583941.312301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143424 00000100:00100000:1.0:1784583941.312305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143424 00000100:00100000:1.0:1784583941.312324:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143936 00000100:00100000:1.0:1784583941.312326:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143936 00000100:00100000:1.0:1784583941.312341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784583941.312349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.312417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599142912:12345-0@lo:400:kworker.0 Request processed in 68us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583941.312424:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784583941.312440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784583941.312446:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.312494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599143424:12345-0@lo:400:kworker.0 Request processed in 48us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583941.312500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784583941.312511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784583941.312518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599143936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.312554:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599143936:12345-0@lo:400:kworker.0 Request processed in 37us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583941.312561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784583941.312825:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784583941.312835:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3640:x1871271599142400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784583941.312854:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583941.312886:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3640:x1871271599142400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.312905:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784583941.313665:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599142784 00000100:00100000:0.0:1784583941.313674:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599142784 00000100:00100000:0.0:1784583941.313710:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784583941.313717:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599142784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.313988:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599142784:12345-0@lo:400:kworker.0 Request processed in 271us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.313994:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784583941.314026:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143296 00000100:00100000:0.0:1784583941.314031:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143296 00000100:00100000:0.0:1784583941.314692:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784583941.314699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599143296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.315130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599143296:12345-0@lo:400:kworker.0 Request processed in 430us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.315139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784583941.315160:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599143808 00000100:00100000:0.0:1784583941.315164:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599143808 00000100:00100000:0.0:1784583941.315190:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784583941.315196:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1871271599143808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.315260:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599142528:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1784583941.315280:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7ce680 x1871271599143552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583941.315291:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599143552:0@lo:400:kworker.0 00010000:00080000:1.0:1784583941.315302:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cc000 x1871271599144064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583941.315310:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599144064:0@lo:400:kworker.0 00000100:00100000:1.0:1784583941.315358:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599142272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583941.316238:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1871271599143808:12345-0@lo:400:kworker.0 Request processed in 1037us (5678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583941.316246:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1784583941.316269:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784583941.316800:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599142784:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.316818:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599143296:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.316830:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599143808:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.316849:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599142400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583941.317105:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599142912:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.317124:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599143424:0@lo:400:kworker.0 00000100:00100000:0.0:1784583941.317135:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599143936:0@lo:400:kworker.0 00000040:00080000:1.0:1784583941.374433:0:14252:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583941.374441:0:14252:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784583941.374505:0:14252:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784583941.374511:0:14252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784583941.486801:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583941.486811:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583941.486836:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784583941.486843:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583941.487185:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599144320:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784583941.487285:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405146840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583941.491823:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.492195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580207360 00000100:00100000:3.0:1784583941.492205:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580207360 00000100:00100000:3.0:1784583941.492277:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:3.0:1784583941.492287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:11421:x1871271580207360:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784583941.492316:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784583941.492429:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:11421:x1871271580207360:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 143us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583941.492436:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:3.0:1784583941.493207:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599144320:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784583941.513293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583941.513453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580207616 00000100:00100000:0.0:1784583941.513463:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580207616 00000100:00100000:0.0:1784583941.513551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:0.0:1784583941.513561:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:11421:x1871271580207616:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583941.513590:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583941.513611:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e482c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee454 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583941.513741:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e482cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583941.513756:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e482cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583941.513766:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e482cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583941.513777:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784583941.513880:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e482c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee454 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583941.513912:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e482cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee454 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583941.513920:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:0.0:1784583941.513923:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784583941.513927:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:0.0:1784583941.513984:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:11421:x1871271580207616:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 425us (701us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784583941.513992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:2.0:1784583941.521245:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.521538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580207872 00000100:00100000:3.0:1784583941.521549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580207872 00000100:00100000:3.0:1784583941.521615:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:3.0:1784583941.521623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:11421:x1871271580207872:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784583941.521691:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.521798:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.521810:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522021:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522029:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522035:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522041:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583941.522045:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522052:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522063:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583941.522066:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583941.522070:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583941.522165:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784583941.523505:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583941.523513:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583941.525117:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784583941.525133:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784583941.535357:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:11421:x1871271580207872:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 13721us (14106us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1784583941.535372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:2.0:1784583941.543118:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583941.543152:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208000 00000100:00100000:2.0:1784583941.543160:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208000 00000100:00100000:2.0:1784583941.543237:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1784583941.543246:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:2399:x1871271580208000:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583941.543262:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583941.543285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e482cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee454 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583941.543303:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:2.0:1784583941.543308:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583941.543358:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:2399:x1871271580208000:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583941.543365:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1784583941.545257:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583941.545287:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208256 00000100:00100000:3.0:1784583941.545295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208256 00000100:00100000:3.0:1784583941.545350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:3.0:1784583941.545360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:11421:x1871271580208256:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784583941.545597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:11421:x1871271580208256:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 238us (347us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1784583941.545605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000001:00080000:0.0:1784583941.811338:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1784583941.811354:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1784583941.812348:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599144448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583941.812414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583941.812867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144448 00000100:00100000:2.0:1784583941.812874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144448 00000100:00100000:2.0:1784583941.812909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784583941.812915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599144448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583941.812942:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784583941.816934:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599144448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4009us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583941.816948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784583941.817535:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599144448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784583942.318125:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784583943.293751:0:14304:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583943.293760:0:14304:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583943.293792:0:14304:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784583943.293799:0:14304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784583943.345268:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583943.539352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583943.543370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208512 00000100:00100000:3.0:1784583943.543383:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208512 00000100:00100000:3.0:1784583943.543442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:3.0:1784583943.543453:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:11441:x1871271580208512:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583943.543499:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583943.543520:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee45b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583943.543615:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583943.543629:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583943.543639:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583943.543649:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784583943.543736:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e482e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee45b expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583943.543755:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee45b expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583943.543776:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583943.543779:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784583943.543782:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216b800, rc 0) 00000100:00100000:3.0:1784583943.543835:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:11441:x1871271580208512:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 386us (4492us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1784583943.543842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00080000:0.0:1784583943.545139:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583943.547313:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583943.547525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208640 00000100:00100000:0.0:1784583943.547535:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208640 00000100:00100000:0.0:1784583943.547589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:0.0:1784583943.547598:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:11441:x1871271580208640:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1784583943.547655:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547671:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547681:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547846:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547855:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547862:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547868:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583943.547873:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547896:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547907:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:0.0:1784583943.547910:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583943.547914:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.547920:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8400/0xdab2421a42e482f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583943.547977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:11441:x1871271580208640:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 380us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583943.547985:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:3.0:1784583943.698365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583943.698509:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208768 00000100:00100000:0.0:1784583943.698518:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208768 00000100:00100000:0.0:1784583943.698583:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:0.0:1784583943.698595:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580208768:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1784583943.698615:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583943.698635:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7eb1c6/0xdab2421a42e48300 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee462 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583943.698660:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a5e9704, atime: 0x6a5e9703, ctime: 0x6a5e9704, blocks: 0x8 00010000:00010000:0.0:1784583943.698678:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1784583943.698683:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583943.698692:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7eb1c6/0xdab2421a42e48300 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee462 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.698727:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e7eb1c6/0xdab2421a42e48300 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee462 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583943.698740:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8400, rc 0) 00000100:00100000:0.0:1784583943.698796:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580208768:12345-192.168.203.51@tcp:101:cat.0 Request processed in 204us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583943.698803:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00080000:1.0:1784583943.698909:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583943.707424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583943.708351:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580208896 00000100:00100000:0.0:1784583943.708362:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580208896 00002000:00100000:0.0:1784583943.708410:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98b42f7cf480 x1871271580208896/t0(0) o3->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:269/0 lens 488/0 e 0 to 0 dl 1784583954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784583943.708422:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b42f7cf480 with x1871271580208896 ext(0->4095) 00002000:00010000:0.0:1784583943.708428:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b42f7cf480 00000100:00100000:0.0:1784583943.708464:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784583943.710047:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580208896:12345-192.168.203.51@tcp:3:cat.0 00000100:00100000:1.0:1784583943.710850:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580208896:12345-192.168.203.51@tcp:3:cat.0 Request processed in 2294us (3431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1784583943.710866:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00002000:00100000:1.0:1784583943.710885:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98b42f7cf480 x1871271580208896/t0(0) o3->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:269/0 lens 488/4536 e 0 to 0 dl 1784583954 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784583943.710895:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b42f7cf480 with x1871271580208896 ext(0->4095) 00002000:00010000:1.0:1784583943.710901:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b42f7cf480 00010000:00010000:0.0:1784583944.365816:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583944.879122:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583944.879146:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599144576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583944.879219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583944.879279:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144576 00000100:00100000:1.0:1784583944.879286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144576 00000100:00100000:1.0:1784583944.879325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784583944.879332:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599144576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583944.879362:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583944.879403:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599144576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583944.879409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784583944.879446:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599144576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784583945.390393:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784583945.905233:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1784583945.905248:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1784583945.906260:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1784583945.906290:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b43cb323c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1784583945.906296:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b304182a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b43cb32840 00000020:00080000:1.0:1784583945.906299:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b304182800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b30381e600 00000020:00080000:1.0:1784583945.906320:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1784583945.906436:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1784583945.906528:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1784583945.907118:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907130:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907138:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907144:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583945.907179:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907205:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907223:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98b43e8a9300) 00010000:00010000:0.0:1784583945.907225:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583945.907231:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583945.907237:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4827b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583946.346804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583946.346867:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583946.346905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583946.347029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583946.347052:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583946.347081:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583946.347455:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209024 00000100:00100000:3.0:1784583946.347487:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209024 00000100:00100000:3.0:1784583946.347556:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 377 00000100:00100000:3.0:1784583946.347565:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580209024:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583946.347636:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580209024:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 72us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.347644:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 377 00000100:00100000:3.0:1784583946.347684:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209408 00000100:00100000:3.0:1784583946.347688:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209408 00000100:00100000:3.0:1784583946.347728:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209536 00000100:00100000:3.0:1784583946.347732:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209536 00000100:00100000:3.0:1784583946.347753:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:3.0:1784583946.347760:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580209408:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583946.347788:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580209408:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.347804:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:3.0:1784583946.347818:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:3.0:1784583946.347825:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580209536:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583946.347850:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580209536:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.347856:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00080000:3.0:1784583946.348022:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583946.348026:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583946.356962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583946.357033:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209152 00000100:00100000:1.0:1784583946.357043:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209152 00000100:00100000:1.0:1784583946.357103:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209280 00000100:00100000:1.0:1784583946.357107:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209280 00000100:00100000:1.0:1784583946.357121:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209664 00000100:00100000:1.0:1784583946.357124:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209664 00000100:00100000:1.0:1784583946.357140:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 282 00000100:00100000:1.0:1784583946.357149:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2400:x1871271580209152:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583946.357234:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2400:x1871271580209152:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 84us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.357241:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 282 00000100:00100000:1.0:1784583946.357258:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 283 00000100:00100000:1.0:1784583946.357264:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580209280:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583946.357291:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580209280:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (10385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.357297:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 283 00000100:00100000:1.0:1784583946.357308:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 284 00000100:00100000:1.0:1784583946.357314:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580209664:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583946.357335:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580209664:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (10254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.357341:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 284 00000100:00080000:1.0:1784583946.361894:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583946.361903:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583946.362718:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209792 00000100:00100000:1.0:1784583946.362728:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209792 00000100:00100000:1.0:1784583946.362790:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 285 00000100:00100000:1.0:1784583946.362799:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580209792:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583946.362878:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580209792:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 80us (5925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.362886:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 285 00000100:00080000:2.0:1784583946.363108:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583946.414019:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583946.414045:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599144704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583946.414117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.414664:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144704 00000100:00100000:1.0:1784583946.414672:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144704 00000100:00100000:1.0:1784583946.414751:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784583946.414761:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599144704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784583946.414789:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784583946.414840:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599144704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.414848:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784583946.414885:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1784583946.414891:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43766f480, transno 4294967311 00000004:00080000:1.0:1784583946.414899:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1784583946.414938:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599144704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784583946.415299:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583946.416120:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599144832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583946.416166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583946.416455:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599144960:0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.416520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.416664:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144832 00000100:00100000:1.0:1784583946.416670:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144832 00000100:00100000:1.0:1784583946.416733:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784583946.416743:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599144832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583946.416767:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583946.416804:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599144832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.416811:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784583946.429267:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599145088:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.429340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583946.443425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599144960 00000100:00100000:3.0:1784583946.443441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599144960 00000100:00100000:3.0:1784583946.443527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784583946.443538:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599144960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.443622:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599144960:12345-0@lo:400:kworker.0 Request processed in 86us (27111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.443630:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784583946.443776:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599145216:0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.443812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583946.444497:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599144832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583946.444539:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599145344:0@lo:400:kworker.0 00000100:00100000:0.0:1784583946.444572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.445479:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599144960:0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.445490:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599145472:0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.445551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.445574:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599145984:0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.445592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.445620:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599146496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583946.445641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583946.445673:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145216 00000100:00100000:1.0:1784583946.445679:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145216 00000100:00100000:1.0:1784583946.445716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145472 00000100:00100000:1.0:1784583946.445719:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145472 00000100:00100000:1.0:1784583946.445732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784583946.445739:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599145216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.445777:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599145216:12345-0@lo:400:kworker.0 Request processed in 38us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.445784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784583946.445796:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784583946.445801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.445826:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599145472:12345-0@lo:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.445831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784583946.445845:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146496 00000100:00100000:1.0:1784583946.445848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146496 00000100:00100000:1.0:1784583946.445873:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784583946.445878:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599146496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583946.445891:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784583946.452278:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599146496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6387us (6623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.452316:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784583946.452369:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145088 00000100:00100000:1.0:1784583946.452377:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145088 00000100:00100000:1.0:1784583946.452426:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145344 00000100:00100000:1.0:1784583946.452429:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145344 00000100:00100000:1.0:1784583946.452439:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145984 00000100:00100000:1.0:1784583946.452441:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145984 00000100:00100000:1.0:1784583946.452460:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784583946.452482:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599145088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.452569:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599145088:12345-0@lo:400:kworker.0 Request processed in 102us (23229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.452576:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784583946.452589:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784583946.452606:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599145344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.452636:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599145344:12345-0@lo:400:kworker.0 Request processed in 32us (8063us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.452642:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784583946.452653:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784583946.452659:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599145984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.452686:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599145984:12345-0@lo:400:kworker.0 Request processed in 27us (7092us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.452692:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784583946.452751:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599146496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583946.452766:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599145472:0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.452777:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599145984:0@lo:400:kworker.0 00000100:00080000:1.0:1784583946.452948:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583946.452952:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784583946.452955:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583946.456676:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599145088:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.456691:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599145600:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.456766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583946.456792:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599146112:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.456812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583946.456850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145600 00000100:00100000:2.0:1784583946.456856:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145600 00000100:00100000:2.0:1784583946.456908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146112 00000100:00100000:2.0:1784583946.456911:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146112 00000100:00100000:2.0:1784583946.457133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784583946.457141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599145600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.457185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599145600:12345-0@lo:400:kworker.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583946.457594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784583946.457613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784583946.457621:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599146112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.457655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599146112:12345-0@lo:400:kworker.0 Request processed in 35us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583946.457661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1784583946.457680:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583946.457696:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583946.457802:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599145216:0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.457811:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599145728:0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.457842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583946.457863:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145728 00000100:00100000:3.0:1784583946.457867:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145728 00000100:00080000:1.0:1784583946.466843:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583946.469185:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599145344:0@lo:400:kworker.0 00010000:00010000:1.0:1784583946.469293:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583946.470719:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599145856:0@lo:400:kworker.0 00000100:00100000:0.0:1784583946.470789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583946.470832:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583946.470858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583946.470892:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146368 00000100:00100000:0.0:1784583946.470898:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146368 00000100:00100000:0.0:1784583946.470969:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784583946.470979:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599146368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784583946.471014:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583946.471052:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599146368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583946.471059:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1784583946.471079:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583946.471103:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1784583946.471109:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1784583946.471128:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b30405ed80, transno 4294967302 00000004:00080000:0.0:1784583946.471138:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1784583946.471148:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b4049b8380, transno 4294967305 00000100:00100000:0.0:1784583946.471161:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583946.471648:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599145856 00000100:00100000:1.0:1784583946.471654:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599145856 00000100:00100000:1.0:1784583946.471695:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784583946.471712:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599145856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583946.471756:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599145856:12345-0@lo:400:kworker.0 Request processed in 45us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583946.471763:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784583946.471880:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599145856:0@lo:400:kworker.0 00010000:00080000:2.0:1784583946.472649:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4376cc700 x1871271599146112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583946.472663:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599146112:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.472688:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599145600:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.473830:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599146240:0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.473888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583946.474066:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146240 00000100:00100000:0.0:1784583946.474074:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146240 00000100:00100000:0.0:1784583946.474127:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784583946.474136:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583946.474346:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599146240:0@lo:400:kworker.0 00000100:00100000:0.0:1784583946.474393:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599146240:12345-0@lo:400:kworker.0 Request processed in 258us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583946.474401:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784583946.475031:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784583946.475047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.475106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599145728:12345-0@lo:400:kworker.0 Request processed in 66us (17263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.475112:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00080000:0.0:1784583946.475296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4376cdc00 x1871271599145728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583946.475307:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599145728:0@lo:400:kworker.0 00000100:00100000:3.0:1784583946.943449:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583946.943495:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599146624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784583946.943562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583946.943632:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146624 00000100:00100000:3.0:1784583946.943640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146624 00000100:00100000:3.0:1784583946.943687:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784583946.943696:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599146624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583946.943751:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1784583946.943796:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599146624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583946.943804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784583946.943847:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599146624:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1784583947.118448:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784583947.501748:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784583947.694611:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583947.694619:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784583947.694641:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784583947.694647:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784583948.525765:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583949.551828:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583950.001123:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599146752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583950.001214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583950.001649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146752 00000100:00100000:3.0:1784583950.001657:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146752 00000100:00100000:3.0:1784583950.001720:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784583950.001730:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599146752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583950.001763:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583950.002069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599146752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 340us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583950.002089:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784583950.002191:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599146752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583950.084015:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583950.084209:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580209920 00000100:00100000:2.0:1784583950.084219:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580209920 00000100:00100000:2.0:1784583950.084282:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00100000:2.0:1784583950.084293:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:11094:x1871271580209920:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784583950.085102:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:11094:x1871271580209920:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 807us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583950.085112:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00080000:0.0:1784583950.085211:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583950.093178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583950.093499:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210048 00000100:00100000:3.0:1784583950.093510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210048 00000100:00100000:3.0:1784583950.093649:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:3.0:1784583950.093659:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:11094:x1871271580210048:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784583950.093957:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:11094:x1871271580210048:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 298us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583950.093965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00080000:0.0:1784583950.094885:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583950.104809:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583950.105993:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210304 00000100:00100000:1.0:1784583950.106007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210304 00000100:00100000:1.0:1784583950.106077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:1.0:1784583950.106088:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:11094:x1871271580210304:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784583950.106326:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:11094:x1871271580210304:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 239us (1526us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1784583950.106334:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:1.0:1784583950.386597:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583950.386802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210432 00000100:00100000:2.0:1784583950.386812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210432 00000100:00100000:2.0:1784583950.386877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:2.0:1784583950.386887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:11899:x1871271580210432:12345-192.168.203.51@tcp:101:lsof.0 00010000:00010000:2.0:1784583950.386906:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583950.386924:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee469 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.386994:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.387008:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.387020:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583950.387060:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784583950.387064:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583950.387095:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.387116:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.387133:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583950.387141:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:2.0:1784583950.387144:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583950.387147:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0e00, rc 0) 00000100:00100000:2.0:1784583950.387215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:11899:x1871271580210432:12345-192.168.203.51@tcp:101:lsof.0 Request processed in 329us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583950.387223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00080000:0.0:1784583950.389441:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784583950.574378:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583951.445180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583951.445227:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583951.445280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583951.445314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210816 00000100:00100000:3.0:1784583951.445325:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210816 00000100:00100000:3.0:1784583951.445372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210688 00000100:00100000:3.0:1784583951.445376:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210688 00000100:00100000:3.0:1784583951.445398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 292 00000100:00100000:3.0:1784583951.445407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580210816:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583951.445706:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580210816:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 298us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583951.446222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 292 00000100:00100000:3.0:1784583951.446249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 293 00000100:00100000:3.0:1784583951.446258:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:2399:x1871271580210688:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583951.446302:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:2399:x1871271580210688:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 47us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583951.446325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 293 00000100:00100000:3.0:1784583951.446370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583951.446443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583951.446620:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210560 00000100:00100000:0.0:1784583951.446627:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210560 00000100:00100000:0.0:1784583951.446665:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 379 00000100:00100000:0.0:1784583951.446673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580210560:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583951.446703:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580210560:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583951.446710:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 379 00000100:00100000:0.0:1784583951.446769:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580210944 00000100:00100000:0.0:1784583951.446773:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580210944 00000100:00100000:0.0:1784583951.446808:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:0.0:1784583951.446815:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580210944:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583951.446843:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2398:x1871271580210944:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583951.446849:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00080000:0.0:1784583951.446865:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583951.447214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211200 00000100:00100000:2.0:1784583951.447219:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211200 00000100:00100000:2.0:1784583951.447255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:2.0:1784583951.447261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2398:x1871271580211200:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583951.447291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2398:x1871271580211200:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 30us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.447297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:1.0:1784583951.456567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583951.456604:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583951.457112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211328 00000100:00100000:2.0:1784583951.457122:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211328 00000100:00100000:2.0:1784583951.457202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 295 00000100:00100000:2.0:1784583951.457213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580211328:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583951.457281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580211328:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 69us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.457289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 295 00000100:00100000:0.0:1784583951.457779:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211072 00000100:00100000:0.0:1784583951.457786:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211072 00000100:00100000:0.0:1784583951.457831:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:0.0:1784583951.457840:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580211072:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583951.457889:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580211072:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 50us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583951.457895:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00080000:1.0:1784583951.458217:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583951.458222:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583951.534355:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599146880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583951.534444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534632:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599147008:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534691:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599147520:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534732:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599148032:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534784:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784583951.534790:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599147136:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534830:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599147648:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534865:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599148160:0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.534884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583951.534912:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147008 00000100:00100000:0.0:1784583951.534919:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147008 00000100:00100000:0.0:1784583951.535218:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784583951.535229:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599147008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583951.535279:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599147008:12345-0@lo:400:kworker.0 Request processed in 52us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583951.535286:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1784583951.550234:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599148544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583951.550311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.550376:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599147008:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.550402:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583951.550410:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599148672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583951.550434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.550502:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599146880 00000100:00100000:2.0:1784583951.550509:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599146880 00000100:00100000:2.0:1784583951.550561:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148544 00000100:00100000:2.0:1784583951.550564:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148544 00000100:00100000:2.0:1784583951.550579:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148672 00000100:00100000:2.0:1784583951.550581:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148672 00000100:00100000:2.0:1784583951.550596:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784583951.550604:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599146880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583951.550650:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583951.550691:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599146880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (16246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.550698:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784583951.550715:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784583951.550722:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599148544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583951.550736:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784583951.550780:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599148544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.550786:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784583951.550798:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784583951.550805:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599148672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583951.550814:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583951.550838:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599148672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.550844:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784583951.550878:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599148672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583951.550894:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599148544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583951.550981:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147136 00000100:00100000:2.0:1784583951.550985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147136 00000100:00100000:2.0:1784583951.551010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147648 00000100:00100000:2.0:1784583951.551013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147648 00000100:00100000:2.0:1784583951.551027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148160 00000100:00100000:2.0:1784583951.551029:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148160 00000100:00100000:2.0:1784583951.551043:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784583951.551049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599147136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599147136:12345-0@lo:400:kworker.0 Request processed in 46us (16278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784583951.551114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784583951.551120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599147648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599147648:12345-0@lo:400:kworker.0 Request processed in 29us (16298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784583951.551179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784583951.551186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599148160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551214:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599148160:12345-0@lo:400:kworker.0 Request processed in 29us (16329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784583951.551250:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599147136:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551260:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599147648:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551270:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599148160:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551303:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599147392:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551331:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551350:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599147904:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551391:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599148416:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551439:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599146880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583951.551461:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784583951.551494:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599147264:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551546:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599147776:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551582:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599148288:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551614:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599148800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583951.551634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583951.551660:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148032 00000100:00100000:2.0:1784583951.551664:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148032 00000100:00100000:2.0:1784583951.551691:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147904 00000100:00100000:2.0:1784583951.551694:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147904 00000100:00100000:2.0:1784583951.551708:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148416 00000100:00100000:2.0:1784583951.551711:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148416 00000100:00100000:2.0:1784583951.551722:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784583951.551727:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599148032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551764:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599148032:12345-0@lo:400:kworker.0 Request processed in 36us (16999us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551770:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784583951.551781:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784583951.551788:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599147904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551818:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599147904:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551824:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784583951.551834:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784583951.551846:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599148416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.551875:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599148416:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.551882:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784583951.551902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147392 00000100:00100000:2.0:1784583951.551905:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147392 00000100:00100000:2.0:1784583951.551921:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147776 00000100:00100000:2.0:1784583951.551924:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147776 00000100:00100000:2.0:1784583951.551937:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148288 00000100:00100000:2.0:1784583951.551939:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148288 00000100:00100000:2.0:1784583951.551952:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784583951.551957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599147392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.552000:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599147392:12345-0@lo:400:kworker.0 Request processed in 42us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.552006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784583951.552018:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1784583951.552029:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599147776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.556092:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599147776:12345-0@lo:400:kworker.0 Request processed in 4057us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.556108:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1784583951.556147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1784583951.556172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599148288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.556246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599148288:12345-0@lo:400:kworker.0 Request processed in 92us (4642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.556253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1784583951.556282:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148800 00000100:00100000:2.0:1784583951.556290:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148800 00000100:00100000:2.0:1784583951.556333:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784583951.556339:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599148800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583951.556354:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784583951.556388:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599148800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583951.556395:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1784583951.560370:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4049b8e00 x1871271599147776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583951.560393:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599147776:0@lo:400:kworker.0 00010000:00080000:2.0:1784583951.560410:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eadea00 x1871271599148288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583951.560419:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599148288:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.560448:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599148800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583951.562940:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599147392:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.563575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599147904:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.563590:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599148416:0@lo:400:kworker.0 00000100:00100000:2.0:1784583951.564117:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599148032:0@lo:400:kworker.0 00000100:00100000:3.0:1784583951.565859:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147520 00000100:00100000:3.0:1784583951.565872:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147520 00000100:00100000:3.0:1784583951.565934:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599147264 00000100:00100000:3.0:1784583951.566094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599147264 00000100:00100000:3.0:1784583951.566164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784583951.566175:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599147520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583951.566316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599147520:12345-0@lo:400:kworker.0 Request processed in 129us (31584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583951.566326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784583951.566342:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784583951.566349:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599147264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583951.566394:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599147264:12345-0@lo:400:kworker.0 Request processed in 45us (14871us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583951.566401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784583951.566516:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599147520:0@lo:400:kworker.0 00000100:00100000:3.0:1784583951.566596:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599147264:0@lo:400:kworker.0 00000100:00080000:1.0:1784583951.567188:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583951.567195:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583951.567198:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784583951.567201:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1784583951.572049:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:3.0:1784583951.572069:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1784583951.572144:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1784583951.572170:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1784583951.599231:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583952.050001:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583952.050041:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599148928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583952.050116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583952.050331:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599148928 00000100:00100000:3.0:1784583952.050339:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599148928 00000100:00100000:3.0:1784583952.050398:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784583952.050407:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599148928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583952.050457:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1784583952.050535:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599148928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583952.050542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784583952.050675:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599148928:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784583952.631961:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583953.654270:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784583954.599076:0:14501:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:45:52 (1784583952) 00010000:00010000:1.0:1784583954.669596:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583955.117837:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583955.117861:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599149056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583955.117933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583955.118584:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149056 00000100:00100000:2.0:1784583955.118594:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149056 00000100:00100000:2.0:1784583955.118663:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784583955.118673:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599149056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583955.118710:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583955.118771:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599149056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583955.118778:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784583955.118999:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599149056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784583955.693989:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583956.571872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.571918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.571952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.571990:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.572009:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.572030:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.572052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583956.572080:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211584 00000100:00100000:3.0:1784583956.572089:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211584 00000100:00100000:3.0:1784583956.572151:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212096 00000100:00100000:3.0:1784583956.572154:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212096 00000100:00100000:3.0:1784583956.572168:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211712 00000100:00100000:3.0:1784583956.572170:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211712 00000100:00100000:3.0:1784583956.572181:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212224 00000100:00100000:3.0:1784583956.572183:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212224 00000100:00100000:3.0:1784583956.572198:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:3.0:1784583956.572206:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2399:x1871271580211584:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583956.572293:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2399:x1871271580211584:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 86us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.572301:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:3.0:1784583956.572317:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 303 00000100:00100000:3.0:1784583956.572325:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580212096:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583956.572351:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2399:x1871271580212096:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.572371:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 303 00000100:00100000:3.0:1784583956.572385:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00100000:3.0:1784583956.572391:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580211712:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583956.572418:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580211712:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.572424:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00100000:3.0:1784583956.572435:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 305 00000100:00100000:3.0:1784583956.572440:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580212224:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583956.572462:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2399:x1871271580212224:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.572499:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 305 00000100:00080000:3.0:1784583956.572521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583956.572524:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583956.573108:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211840 00000100:00100000:2.0:1784583956.573114:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211840 00000100:00100000:2.0:1784583956.573163:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211968 00000100:00100000:2.0:1784583956.573166:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211968 00000100:00100000:2.0:1784583956.573185:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:2.0:1784583956.573193:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580211840:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583956.573225:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2399:x1871271580211840:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.573232:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:2.0:1784583956.573255:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:2.0:1784583956.573263:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580211968:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583956.573296:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2399:x1871271580211968:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.573302:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1784583956.574534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580211456 00000100:00100000:0.0:1784583956.574542:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580211456 00000100:00100000:0.0:1784583956.574580:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 381 00000100:00100000:0.0:1784583956.574588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580211456:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583956.574630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580211456:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 43us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583956.574649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 381 00000100:00080000:3.0:1784583956.578454:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784583956.578464:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583956.655878:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599149440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583956.655962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583956.656012:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583956.656029:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599149568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784583956.656051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583956.669421:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149440 00000100:00100000:2.0:1784583956.669438:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149440 00000100:00100000:2.0:1784583956.669545:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149568 00000100:00100000:2.0:1784583956.669549:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149568 00000100:00100000:2.0:1784583956.669569:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784583956.669578:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599149440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583956.669624:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583956.669708:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599149440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (13745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.670002:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784583956.670081:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784583956.670088:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599149568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583956.670100:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583956.670140:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599149568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (14088us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.670146:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1784583956.670202:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583956.670487:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3039f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599149568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583956.670503:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599149440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583956.671416:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784583956.671452:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599149696:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.671511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583956.671558:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583956.671582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583956.671605:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149312 00000100:00100000:3.0:1784583956.671611:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149312 00000100:00100000:3.0:1784583956.671646:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784583956.671652:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599149312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784583956.671673:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784583956.671714:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599149312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.671721:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1784583956.671738:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583956.671761:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583956.671768:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599149184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583956.671788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583956.671804:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149184 00000100:00100000:3.0:1784583956.671807:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149184 00000100:00100000:3.0:1784583956.671829:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784583956.671834:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599149184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583956.671842:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784583956.671863:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599149184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583956.671868:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1784583956.671878:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784583956.671894:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599149184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583956.675241:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149696 00000100:00100000:2.0:1784583956.675257:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149696 00000100:00100000:2.0:1784583956.675316:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1784583956.675326:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599149696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583956.675410:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4017eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599149696:12345-0@lo:400:kworker.0 Request processed in 86us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.675418:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784583956.676048:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599149696:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.683927:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583956.684015:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583956.684037:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599149952:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.684107:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583956.684169:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149952 00000100:00100000:1.0:1784583956.684175:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149952 00000100:00100000:1.0:1784583956.684225:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784583956.684233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599149952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.684299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599149952:12345-0@lo:400:kworker.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583956.684307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784583956.684350:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599149952:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.685509:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784583956.685520:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599150080:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.685557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583956.685591:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150080 00000100:00100000:1.0:1784583956.685596:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150080 00000100:00100000:1.0:1784583956.685643:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1784583956.685649:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599150080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.685688:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599150080:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583956.685695:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1784583956.685726:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599150080:0@lo:400:kworker.0 00000100:00100000:0.0:1784583956.685788:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583956.685805:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599150208:0@lo:400:kworker.0 00000100:00100000:0.0:1784583956.685837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583956.685877:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150208 00000100:00100000:2.0:1784583956.685882:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150208 00000100:00100000:2.0:1784583956.685918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784583956.685925:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599150208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583956.685963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599150208:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.685975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784583956.688726:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599150208:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.697599:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599149824:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.697672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583956.698042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599149824 00000100:00100000:0.0:1784583956.698050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599149824 00000100:00100000:0.0:1784583956.698109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784583956.698119:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583956.698185:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599149824:12345-0@lo:400:kworker.0 Request processed in 67us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583956.698206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784583956.698442:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583956.698619:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212480 00000100:00100000:0.0:1784583956.698623:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212480 00000100:00100000:0.0:1784583956.698662:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:0.0:1784583956.698670:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:12166:x1871271580212480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583956.698684:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583956.698705:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e48315 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee470 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698772:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698787:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698800:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698854:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698863:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698869:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698960:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4832a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698981:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4832a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.698989:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4832a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583956.698999:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784583956.699085:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699093:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699100:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699106:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583956.699111:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699120:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699143:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784583956.699147:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583956.699152:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699158:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e4831c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699172:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699183:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699189:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699195:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583956.699198:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699204:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699213:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98b301fd1900) 00010000:00010000:0.0:1784583956.699216:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583956.699219:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699225:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48323 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699550:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e48315 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee470 expref: 16 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699566:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4832a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee470 expref: 15 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583956.699573:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:0.0:1784583956.699576:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583956.699585:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:0.0:1784583956.699633:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:12166:x1871271580212480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 963us (1192us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784583956.699641:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:3.0:1784583956.699991:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599149824:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.700716:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583956.700728:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599150464:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.700804:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583956.700845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150464 00000100:00100000:1.0:1784583956.700850:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150464 00000100:00100000:1.0:1784583956.700896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784583956.700905:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599150464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.700947:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599150464:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583956.700954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:1.0:1784583956.700983:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766f480 x1871271599150464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583956.700995:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599150464:0@lo:400:kworker.0 00000100:00080000:1.0:1784583956.701010:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583956.701034:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599150592:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.701057:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583956.701083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150592 00000100:00100000:1.0:1784583956.701086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150592 00000100:00100000:1.0:1784583956.701114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784583956.701120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599150592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.701175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599150592:12345-0@lo:400:kworker.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583956.701181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784583956.701206:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599150592:0@lo:400:kworker.0 00000100:00080000:1.0:1784583956.701220:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583956.701717:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599150720:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.701749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583956.701784:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784583956.701808:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599150336:0@lo:400:kworker.0 00000100:00100000:3.0:1784583956.701833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583956.701906:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150720 00000100:00100000:2.0:1784583956.701911:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150720 00000100:00100000:2.0:1784583956.701950:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150336 00000100:00100000:2.0:1784583956.701953:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150336 00000100:00100000:2.0:1784583956.701971:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784583956.701979:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599150720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583956.702018:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599150720:12345-0@lo:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.702024:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784583956.702037:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784583956.702043:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583956.702069:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599150336:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.702075:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1784583956.703534:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583956.703540:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583956.703579:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599150336:0@lo:400:kworker.0 00010000:00080000:3.0:1784583956.703594:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b420303100 x1871271599150720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583956.703604:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599150720:0@lo:400:kworker.0 00000100:00100000:1.0:1784583956.713566:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583956.713658:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583956.714111:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212608 00000100:00100000:2.0:1784583956.714130:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212608 00000100:00100000:2.0:1784583956.714199:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784583956.714209:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a57c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:2398:x1871271580212608:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583956.714226:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583956.714249:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4832a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee470 expref: 15 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583956.714267:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:2.0:1784583956.714272:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583956.714337:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a57c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:2398:x1871271580212608:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 130us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.714345:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1784583956.717265:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212736 00000100:00100000:3.0:1784583956.717278:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212736 00010000:00010000:1.0:1784583956.718934:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583956.721777:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:2.0:1784583956.721791:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:12166:x1871271580212736:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784583956.721903:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:12166:x1871271580212736:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 114us (8243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583956.721911:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:2.0:1784583956.735839:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583956.735939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212864 00000100:00100000:1.0:1784583956.735947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212864 00000100:00100000:1.0:1784583956.736010:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 152 00000100:00100000:1.0:1784583956.736020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:12166:x1871271580212864:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784583956.736140:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:12166:x1871271580212864:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583956.736148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 152 00000040:00080000:2.0:1784583956.909864:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784583956.909874:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784583956.910424:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784583956.910435:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784583957.174719:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784583957.174740:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599150848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583957.174808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583957.174976:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599150848 00000100:00100000:3.0:1784583957.174984:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599150848 00000100:00100000:3.0:1784583957.175031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784583957.175040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599150848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583957.175070:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1784583957.175109:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599150848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583957.175116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784583957.175196:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599150848:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1784583957.359503:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784583957.742544:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784583957.937816:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583957.937827:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784583957.937938:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1784583957.937945:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784583958.766372:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583959.525252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.525320:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580212992 00000100:00100000:3.0:1784583959.525328:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580212992 00000100:00080000:1.0:1784583959.525438:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583959.525510:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:3.0:1784583959.525521:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:12209:x1871271580212992:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583959.525556:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583959.525576:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee477 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525650:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525664:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525677:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525692:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525699:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525706:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525747:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525753:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525759:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525765:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583959.525775:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525783:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525796:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583959.525798:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583959.525803:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525809:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4833f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525822:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525991:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.525999:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526005:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583959.526009:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526015:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526024:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583959.526027:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583959.526036:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526043:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48346 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526076:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48338 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee477 expref: 15 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526086:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583959.526089:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583959.526092:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e48338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee477 expref: 15 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.526102:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216b000, rc 0) 00000100:00100000:3.0:1784583959.526209:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:12209:x1871271580212992:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 690us (965us total) trans 0 rc 301/301 00000100:00100000:3.0:1784583959.526217:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:1.0:1784583959.536926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.537140:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580213248 00000100:00100000:3.0:1784583959.537150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580213248 00000100:00100000:3.0:1784583959.537201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:3.0:1784583959.537211:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+14:12209:x1871271580213248:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:3.0:1784583959.537265:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583959.537292:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e47c8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee29b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.537310:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583959.537315:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583959.537400:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.537414:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.537424:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.537493:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.537507:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 5 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583959.537523:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599150976:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583959.537600:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac240 going to sleep for 11 seconds 00000100:00100000:3.0:1784583959.544343:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599150976:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583959.544370:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583959.544624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.544704:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580213376 00000100:00100000:3.0:1784583959.544710:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580213376 00010000:00010000:3.0:1784583959.544756:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 6 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583959.544789:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:3.0:1784583959.544797:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2400:x1871271580213376:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583959.544811:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583959.544838:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 6 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544851:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 6 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544873:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4830e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee469 expref: 6 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544886:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583959.544891:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544899:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544905:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.544923:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583959.544964:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580213376:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 167us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583959.544970:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00010000:00010000:3.0:1784583959.545342:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.545350:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.545371:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.545391:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.545399:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.546340:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.546355:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.546364:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583959.546379:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000989e1324 reply state 0000000079e88c21 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.546390:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.546397:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583959.546400:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583959.546403:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:1.0:1784583959.547751:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1784583959.547898:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784583959.547913:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.547923:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.547930:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.547944:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583959.547949:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.547956:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.547970:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b30397a100) 00010000:00010000:3.0:1784583959.547973:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583959.547977:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.548531:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e4834d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583959.548550:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000989e1324 reply state 0000000079e88c21 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.548561:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.548567:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98b43e8a9d00) 00010000:00010000:3.0:1784583959.548570:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583959.548572:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784583959.549178:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:12209:x1871271580213248:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 11964us (12257us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1784583959.549188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:3.0:1784583959.693167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583959.694119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580213504 00000100:00100000:0.0:1784583959.694131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580213504 00000100:00100000:0.0:1784583959.695146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 155 00000100:00100000:0.0:1784583959.695158:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+15:12217:x1871271580213504:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:0.0:1784583959.695181:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583959.695203:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee47e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.695265:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.695279:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.695291:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583959.695337:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784583959.695342:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583959.695365:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.695388:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee47e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.695438:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee47e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.697076:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:0.0:1784583959.697087:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583959.697092:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9e00, rc 0) 00000100:00100000:0.0:1784583959.697172:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:12217:x1871271580213504:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 2013us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583959.697180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 155 00010000:00010000:2.0:1784583959.791510:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583959.823174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583959.823276:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580213632 00000100:00100000:1.0:1784583959.823285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580213632 00000100:00100000:1.0:1784583959.823356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00100000:1.0:1784583959.823365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+16:12223:x1871271580213632:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784583959.823385:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583959.823405:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee485 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583959.823502:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583959.823517:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583959.823683:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823770:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823781:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823789:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823863:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823872:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823891:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583959.823924:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784583959.823927:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583959.823944:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823955:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823962:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823969:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823975:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583959.823979:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.823987:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824008:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:2.0:1784583959.824011:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583959.824016:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e48377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824046:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824053:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824063:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824069:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583959.824072:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824079:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824088:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98b43e8a9d00) 00010000:00010000:2.0:1784583959.824090:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583959.824093:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824099:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4837e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824134:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee485 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824148:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee485 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.824166:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583959.824168:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784583959.824171:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0000, rc 0) 00000100:00100000:2.0:1784583959.824232:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:12223:x1871271580213632:12345-192.168.203.51@tcp:101:bash.0 Request processed in 867us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583959.824239:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00100000:0.0:1784583959.832539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.832669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580213888 00000100:00100000:2.0:1784583959.832678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580213888 00000100:00100000:2.0:1784583959.832733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 157 00000100:00100000:2.0:1784583959.832743:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:12223:x1871271580213888:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583959.832761:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583959.832780:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4838c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee48c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832891:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832906:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832917:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832931:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832938:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.832962:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784583959.833267:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1784583959.833387:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833397:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833405:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833433:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833440:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833447:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833453:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583959.833457:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833464:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583959.833506:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583959.833516:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833523:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48393 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583959.833546:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054a4a160 reply state 000000001ff4d33c transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833557:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833564:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:2.0:1784583959.833566:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784583959.833569:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784583959.833594:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4838c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833607:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.833614:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:2.0:1784583959.833616:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583959.833618:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1000, rc 0) 00000100:00100000:2.0:1784583959.833671:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:12223:x1871271580213888:12345-192.168.203.51@tcp:101:bash.0 Request processed in 929us (1148us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1784583959.833678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 157 00000100:00100000:3.0:1784583959.838436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583959.838624:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580214016 00000100:00100000:0.0:1784583959.838633:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580214016 00000100:00100000:0.0:1784583959.838700:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1784583959.838711:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580214016:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583959.838727:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583959.838748:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee493 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583959.838772:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784583959.838791:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1784583959.838795:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583959.838805:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.838837:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.838851:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8800, rc 0) 00000100:00100000:0.0:1784583959.838905:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580214016:12345-192.168.203.51@tcp:101:bash.0 Request processed in 196us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583959.838912:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00080000:1.0:1784583959.839163:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583959.844217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.844383:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580214144 00000100:00100000:2.0:1784583959.844393:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580214144 00000100:00100000:2.0:1784583959.844570:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:2.0:1784583959.844582:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:12223:x1871271580214144:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583959.844698:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583959.844724:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee49a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.844759:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.844769:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583959.844773:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583959.844778:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.844813:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.844827:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583959.844841:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1871271599151104:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583959.844940:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40240 going to sleep for 11 seconds 00000100:00100000:2.0:1784583959.847676:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4049b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1871271599151104:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583959.847796:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.847817:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0a00, rc 0) 00000100:00100000:1.0:1784583959.847876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.847889:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:12223:x1871271580214144:12345-192.168.203.51@tcp:101:bash.0 Request processed in 3308us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583959.847900:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:0.0:1784583959.848164:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580214272 00000100:00100000:0.0:1784583959.848172:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580214272 00010000:00010000:0.0:1784583959.848202:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583959.848231:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:0.0:1784583959.848240:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580214272:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583959.848254:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583959.848290:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.848304:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.848327:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e483af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee493 expref: 7 pid: 8805 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.848354:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583959.848359:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583959.848368:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.848379:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.848413:0:8443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583959.848428:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1871271599151232:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583959.849090:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583959.851618:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.851745:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580214528 00000100:00100000:2.0:1784583959.851753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580214528 00000100:00100000:0.0:1784583959.851757:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1871271599151232:192.168.203.51@tcp:105: 00010000:00010000:0.0:1784583959.851782:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583959.851825:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580214272:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 3586us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583959.851835:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:2.0:1784583959.851885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1784583959.851895:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:12223:x1871271580214528:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1784583959.852132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12223:x1871271580214528:12345-192.168.203.51@tcp:35:bash.0 Request processed in 238us (521us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1784583959.852140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1784583959.908549:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583959.909001:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580214784 00000100:00100000:0.0:1784583959.909014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580214784 00000100:00100000:0.0:1784583959.909118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:0.0:1784583959.909128:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12233:x1871271580214784:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583959.909149:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583959.909166:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e483bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4a1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583959.909267:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784583959.909355:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e483bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4a1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.909370:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:0.0:1784583959.909373:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583959.909378:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e483bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4a1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.909391:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8800, rc 0) 00000100:00100000:0.0:1784583959.909712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12233:x1871271580214784:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 585us (1178us total) trans 4294967422 rc 301/301 00000100:00100000:0.0:1784583959.909720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:0.0:1784583959.915687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.915778:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215040 00000100:00100000:3.0:1784583959.915787:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215040 00000100:00100000:3.0:1784583959.915853:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:3.0:1784583959.915864:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12233:x1871271580215040:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583959.916073:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12233:x1871271580215040:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 211us (395us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1784583959.916082:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:1.0:1784583959.955338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.955522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215168 00000100:00100000:2.0:1784583959.955532:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215168 00000100:00100000:2.0:1784583959.955580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:2.0:1784583959.955589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12239:x1871271580215168:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583959.955612:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583959.955631:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e483cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955697:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955711:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955723:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583959.955766:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784583959.955783:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583959.955805:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955831:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e483cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4a8 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955848:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4a8 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.955857:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583959.955859:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583959.955863:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1600, rc 0) 00000100:00100000:2.0:1784583959.955924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12239:x1871271580215168:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 335us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583959.955932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:1.0:1784583959.962887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.962963:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215424 00000100:00100000:2.0:1784583959.962972:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215424 00000100:00100000:2.0:1784583959.963039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:2.0:1784583959.963050:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12239:x1871271580215424:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583959.963070:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583959.963090:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e483d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4af expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.963210:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e483e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.963224:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e483e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.963254:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e483e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583959.963267:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784583959.963371:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e483d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4af expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.963390:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e483e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4af expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.963399:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:2.0:1784583959.963402:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583959.963406:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0e00, rc 0) 00000100:00100000:2.0:1784583959.963491:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+26:12239:x1871271580215424:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 420us (590us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1784583959.963499:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:3.0:1784583959.968994:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.969074:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583959.969099:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215808 00000100:00100000:2.0:1784583959.969118:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215808 00000100:00100000:2.0:1784583959.969188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1784583959.969198:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+26:2399:x1871271580215808:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583959.969215:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583959.969239:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e483e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4af expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583959.969258:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:2.0:1784583959.969263:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583959.969332:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:2399:x1871271580215808:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 135us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583959.969340:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1784583959.969762:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215680 00000100:00100000:0.0:1784583959.969768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215680 00000100:00100000:0.0:1784583959.969810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:0.0:1784583959.969818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12239:x1871271580215680:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583959.969847:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583959.969864:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e483ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.969954:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.969968:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.969988:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583959.970001:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784583959.970097:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e483ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4b6 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.970125:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4b6 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.970134:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:0.0:1784583959.970137:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784583959.970140:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8200, rc 0) 00000100:00100000:0.0:1784583959.970185:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12239:x1871271580215680:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 368us (1111us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1784583959.970193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:3.0:1784583959.979177:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583959.979286:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580215936 00000100:00100000:0.0:1784583959.979295:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580215936 00000100:00100000:0.0:1784583959.979354:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1784583959.979363:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580215936:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:0.0:1784583959.979407:0:11860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.979429:0:11860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.979439:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583959.979505:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583959.979510:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.979549:0:11860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583959.979565:0:11860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 6 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583959.979581:0:11860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11860:1871271599151360:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583959.979684:0:11860:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583959.984109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583959.984291:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216064 00000100:00100000:3.0:1784583959.984299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216064 00002000:00100000:3.0:1784583959.984343:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98b4049b9500 x1871271580216064/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:285/0 lens 504/0 e 0 to 0 dl 1784583970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784583959.984355:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b4049b9500 with x1871271580216064 ext(0->12) 00010000:00010000:3.0:1784583959.984364:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 7 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.984379:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 7 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784583959.984387:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b4049b9500 00000100:00100000:3.0:1784583959.984418:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784583959.984427:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580216064:12345-192.168.203.51@tcp:4:lfs.0 00000100:00100000:0.0:1784583959.985527:0:11860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11860:1871271599151360:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583959.985550:0:11860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583959.987424:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2400:x1871271580216064:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 2990us (3324us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784583959.987448:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00002000:00100000:3.0:1784583959.987507:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98b4049b9500 x1871271580216064/t4294967306(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:285/0 lens 504/448 e 0 to 0 dl 1784583970 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784583959.987517:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b4049b9500 with x1871271580216064 ext(0->12) 00010000:00010000:3.0:1784583959.987528:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583959.987546:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784583959.987555:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98b4049b9500 00000100:00100000:3.0:1784583960.001552:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.001632:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216192 00000100:00100000:2.0:1784583960.001641:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216192 00010000:00010000:2.0:1784583960.001678:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.001709:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:2.0:1784583960.001718:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2400:x1871271580216192:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583960.001732:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784583960.001748:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784583960.001751:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784583960 00002000:00010000:2.0:1784583960.001753:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784583960 00002000:00010000:2.0:1784583960.001756:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784583960 00002000:00010000:2.0:1784583960.001758:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784583960.001764:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.001777:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.001800:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf6b015/0xdab2421a42e483b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee49a expref: 9 pid: 8426 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.001817:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583960.001834:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583960.001839:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.001848:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.001885:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583960.001999:0:11860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002009:0:11860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002028:0:11860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002036:0:11860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002044:0:11860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002058:0:11860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583960.002063:0:11860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002071:0:11860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002083:0:11860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.002091:0:11860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e48403 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.002211:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580216192:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 492us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.002219:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:3.0:1784583960.002450:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580215936:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 23086us (23280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583960.002459:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1784583960.008729:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.008808:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216448 00000100:00100000:3.0:1784583960.008818:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216448 00000100:00100000:3.0:1784583960.008873:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1784583960.008883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12239:x1871271580216448:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:3.0:1784583960.008945:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4b6 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583960.009130:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1784583960.009167:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1784583960.009506:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:3.0:1784583960.009544:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.009559:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.009569:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.009959:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.009975:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 31 pid: 6514 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583960.009990:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599151488:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583960.010074:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583960.013525:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599151488:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583960.013554:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583960.013980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.014064:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216576 00000100:00100000:2.0:1784583960.014072:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216576 00010000:00010000:2.0:1784583960.014115:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 32 pid: 6514 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.014151:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:2.0:1784583960.014160:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:2401:x1871271580216576:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583960.014176:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583960.014183:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 32 pid: 6514 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014195:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 32 pid: 6514 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014216:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e483a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee48c expref: 32 pid: 6514 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014245:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:2.0:1784583960.014250:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014259:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014267:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.014291:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583960.014342:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+31:2401:x1871271580216576:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 183us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.014350:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00010000:00010000:3.0:1784583960.014500:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.014509:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583960.014625:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1784583960.014721:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1784583960.014804:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599151616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583960.014846:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583960.014868:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aace40 going to sleep for 11 seconds 00000100:00100000:2.0:1784583960.015048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599151616 00000100:00100000:2.0:1784583960.015054:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599151616 00000100:00100000:2.0:1784583960.015088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784583960.015095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599151616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583960.015171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599151616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.015177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1784583960.015299:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784583960.016020:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599151616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784583960.016140:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:3.0:1784583960.016183:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599151744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583960.016212:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583960.016236:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aacc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784583960.016324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599151744 00000100:00100000:2.0:1784583960.016328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599151744 00000100:00100000:2.0:1784583960.016362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784583960.016369:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599151744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784583960.016493:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1871271599151744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (279us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784583960.016513:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784583960.016781:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599151744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784583960.016815:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1784583960.016844:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016855:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016862:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016869:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583960.016873:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016880:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016894:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:3.0:1784583960.016897:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784583960.016901:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.016923:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4840a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784583960.017000:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784583960.017061:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1784583960.017071:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403202603058ns, next at 404202601392ns, rc = 0 00000001:00080000:3.0:1784583960.017077:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1784583960.017095:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0600) 00010000:00010000:3.0:1784583960.017098:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784583960.017117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e483f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4b6 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583960.017199:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:12239:x1871271580216448:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 8318us (8480us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1784583960.017207:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000020:00080000:3.0:1784583960.017210:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784583960.021933:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.022285:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216704 00000100:00100000:2.0:1784583960.022295:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216704 00000100:00100000:2.0:1784583960.022350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:2.0:1784583960.022358:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:12239:x1871271580216704:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583960.022381:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583960.022403:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e48411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.022490:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e48411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4bd expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.022506:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e48411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4bd expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.022524:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583960.022527:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784583960.022530:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0a00, rc 0) 00000100:00100000:2.0:1784583960.022592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:12239:x1871271580216704:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 235us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.022598:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:1.0:1784583960.025336:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.025414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580216960 00000100:00100000:2.0:1784583960.025423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580216960 00000100:00100000:2.0:1784583960.025504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1784583960.025514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:12239:x1871271580216960:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583960.025938:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:12239:x1871271580216960:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 424us (608us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1784583960.025958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:1.0:1784583960.107305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.107388:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580217216 00000100:00100000:3.0:1784583960.107397:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580217216 00000100:00100000:3.0:1784583960.107497:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:3.0:1784583960.107507:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+36:12249:x1871271580217216:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583960.107528:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583960.107547:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e48418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4c4 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583960.107650:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784583960.107739:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e48418 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4c4 expref: 38 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.107771:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:3.0:1784583960.107775:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583960.107779:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e48418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4c4 expref: 38 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.107792:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216a600, rc 0) 00000100:00100000:3.0:1784583960.107842:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12249:x1871271580217216:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 336us (546us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1784583960.107849:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:1.0:1784583960.113242:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.113319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580217344 00000100:00100000:2.0:1784583960.113328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580217344 00000100:00100000:2.0:1784583960.113385:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:2.0:1784583960.113394:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12249:x1871271580217344:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1784583960.113510:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113525:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113536:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113545:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113553:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113560:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113639:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113647:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113652:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583960.113713:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113725:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113732:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113739:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113745:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583960.113749:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113757:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113768:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583960.113771:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583960.113774:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113781:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e48426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113797:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113802:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113815:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113820:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583960.113823:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113831:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113838:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:2.0:1784583960.113841:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583960.113844:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113850:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e4842d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113859:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113865:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113870:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113875:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583960.113878:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113892:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113900:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583960.113902:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583960.113905:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.113911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e48434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.113967:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12249:x1871271580217344:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 573us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.113975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:1.0:1784583960.115909:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.115999:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580217600 00000100:00100000:2.0:1784583960.116008:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580217600 00000100:00100000:2.0:1784583960.116094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:2.0:1784583960.116115:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12249:x1871271580217600:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583960.116319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:12249:x1871271580217600:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 215us (414us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1784583960.116327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1784583960.162127:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.162437:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580217856 00000100:00100000:3.0:1784583960.162446:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580217856 00000100:00100000:3.0:1784583960.162528:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:3.0:1784583960.162538:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:12252:x1871271580217856:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583960.162560:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583960.162587:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4843b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4cb expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162661:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162675:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162685:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162696:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162715:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162722:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162818:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162826:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162833:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583960.162841:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784583960.162906:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162914:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162920:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162927:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583960.162930:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162937:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162957:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583960.162960:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583960.162964:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162971:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162985:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162990:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.162997:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163001:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583960.163004:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163009:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163016:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:3.0:1784583960.163018:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583960.163020:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163026:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163067:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e4843b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 41 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163081:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 40 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.163089:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583960.163091:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583960.163093:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583960.163166:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12252:x1871271580217856:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 628us (1047us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784583960.163173:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:1.0:1784583960.166443:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.167078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580217984 00000100:00100000:2.0:1784583960.167087:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580217984 00000100:00100000:2.0:1784583960.167181:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:2.0:1784583960.167192:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12252:x1871271580217984:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1784583960.167255:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167288:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167299:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167334:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167342:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167348:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167354:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583960.167359:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167367:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167377:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583960.167380:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784583960.167384:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.167390:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4845e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.167499:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12252:x1871271580217984:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 308us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.167512:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:1.0:1784583960.169775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.169885:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580218240 00000100:00100000:3.0:1784583960.169894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580218240 00000100:00100000:3.0:1784583960.169939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784583960.169948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12252:x1871271580218240:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583960.170162:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:12252:x1871271580218240:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 215us (395us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1784583960.170170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784583960.238143:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583960.238165:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599151872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583960.238241:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583960.238349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599151872 00000100:00100000:0.0:1784583960.238357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599151872 00000100:00100000:0.0:1784583960.238407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784583960.238416:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599151872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784583960.238456:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784583960.238520:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599151872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583960.238527:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784583960.238916:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599151872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583960.485236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.485685:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580218496 00000100:00100000:3.0:1784583960.485694:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580218496 00000100:00100000:3.0:1784583960.485813:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 167 00000100:00100000:3.0:1784583960.485825:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:12283:x1871271580218496:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1784583960.485973:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583960.485994:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4d2 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.486105:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4846c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.486120:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4846c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.486131:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4846c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583960.486141:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784583960.486236:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d2 expref: 44 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.486253:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4846c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d2 expref: 43 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583960.486262:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583960.486265:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583960.486267:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583960.486365:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12283:x1871271580218496:12345-192.168.203.51@tcp:101:cat.0 Request processed in 542us (1138us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1784583960.486372:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 167 00000100:00100000:1.0:1784583960.494353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583960.494440:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580218624 00000100:00100000:0.0:1784583960.494464:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580218624 00000100:00100000:0.0:1784583960.494551:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:0.0:1784583960.494561:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:2399:x1871271580218624:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583960.494575:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583960.494600:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4846c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d2 expref: 43 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.494619:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583960.494625:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583960.494678:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:2399:x1871271580218624:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583960.494685:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1784583960.499040:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583960.499148:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580218880 00000100:00100000:3.0:1784583960.499164:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580218880 00000100:00100000:3.0:1784583960.499370:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:0.0:1784583960.499566:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:12283:x1871271580218880:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:0.0:1784583960.499895:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12283:x1871271580218880:12345-192.168.203.51@tcp:35:cat.0 Request processed in 512us (864us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784583960.499905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1784583960.631023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583960.631178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580219136 00000100:00100000:0.0:1784583960.631187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580219136 00000100:00100000:0.0:1784583960.631243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00100000:0.0:1784583960.631253:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12289:x1871271580219136:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1784583960.631283:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583960.631286:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784583960.631311:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e483d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4a8 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631348:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583960.631353:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583960.631366:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e4847a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631539:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631554:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 43 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631562:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631593:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 43 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.631607:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 43 pid: 9809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583960.631622:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599152000:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583960.631704:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583960.644645:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1871271599152000:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583960.644674:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583960.652659:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.652767:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580219264 00000100:00100000:2.0:1784583960.652777:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580219264 00010000:00010000:2.0:1784583960.652820:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 44 pid: 9809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583960.652864:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:2.0:1784583960.652874:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:2401:x1871271580219264:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583960.652889:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583960.652897:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 44 pid: 9809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.652921:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 44 pid: 9809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.652942:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4cb expref: 44 pid: 9809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.652959:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583960.652964:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.652974:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.652982:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.653205:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583960.653262:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:2401:x1871271580219264:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 389us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583960.653270:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00010000:00010000:0.0:1784583960.658433:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.658840:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583960.658864:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784583960.659837:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e4847a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.659864:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.659874:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583960.659877:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784583960.659881:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:0.0:1784583960.659954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12289:x1871271580219136:12345-192.168.203.51@tcp:101:dd.0 Request processed in 28702us (28939us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1784583960.659964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00100000:1.0:1784583960.672651:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583960.672760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580219392 00000100:00100000:0.0:1784583960.672769:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580219392 00000100:00100000:0.0:1784583960.672826:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 169 00000100:00100000:0.0:1784583960.672836:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12289:x1871271580219392:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1784583960.672859:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583960.672880:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e4848f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.672917:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.672949:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.672961:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.673067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e4848f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.673085:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583960.673094:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583960.673241:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784583960.673246:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9000, rc 0) 00000100:00100000:0.0:1784583960.673299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:12289:x1871271580219392:12345-192.168.203.51@tcp:101:dd.0 Request processed in 464us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583960.673306:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 169 00000100:00100000:1.0:1784583960.678817:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583960.678963:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580219648 00000100:00100000:2.0:1784583960.678973:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580219648 00000100:00100000:2.0:1784583960.679033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 170 00000100:00100000:2.0:1784583960.679044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:12289:x1871271580219648:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:2.0:1784583960.679299:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.679318:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.679329:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784583960.679366:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1784583960.679385:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000665ae6a4 reply state 00000000aa28b09b transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.679397:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583960.679405:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583960.679408:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784583960.679412:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784583960.679538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:12289:x1871271580219648:12345-192.168.203.51@tcp:36:dd.0 Request processed in 495us (730us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1784583960.679556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 170 00000020:00080000:2.0:1784583960.679561:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784583960.813815:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583961.126559:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.126659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580219776 00000100:00100000:0.0:1784583961.126669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580219776 00000100:00100000:0.0:1784583961.126874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 171 00000100:00100000:0.0:1784583961.126886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:12303:x1871271580219776:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:0.0:1784583961.126909:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583961.126931:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e484a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.126992:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127018:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127031:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127043:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127052:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127058:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127140:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127151:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127160:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127191:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.127206:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 48 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583961.127233:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599152128:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583961.129617:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff840 going to sleep for 11 seconds 00000100:00080000:1.0:1784583961.129724:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583961.136878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583961.136969:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580220032 00000100:00100000:2.0:1784583961.136978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580220032 00000100:00100000:2.0:1784583961.137041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784583961.137052:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:6168:x1871271580220032:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784583961.137345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:6168:x1871271580220032:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 295us (487us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1784583961.137352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:0.0:1784583961.138846:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599152128:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583961.138889:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583961.139958:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.140132:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580220160 00000100:00100000:0.0:1784583961.140140:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580220160 00010000:00010000:0.0:1784583961.140175:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 50 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583961.140211:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:0.0:1784583961.140219:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:2401:x1871271580220160:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583961.140232:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583961.140240:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 50 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.140252:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 50 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.140273:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e48481 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4d9 expref: 50 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.140288:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583961.140292:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.140315:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.140322:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.142193:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583961.142276:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:2401:x1871271580220160:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2052us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.142287:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00010000:00010000:1.0:1784583961.144727:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144742:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583961.144803:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784583961.144808:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583961.144830:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144856:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144862:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144869:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144898:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.144902:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144909:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144924:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:1.0:1784583961.144927:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.144931:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144940:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e484ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144955:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144960:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144965:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144970:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.144972:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144977:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.144995:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:1.0:1784583961.144997:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.145001:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.145006:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e484b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.145043:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e484a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e7 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.145056:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e7 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.145062:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583961.145064:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583961.145066:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9a00, rc 0) 00000100:00100000:1.0:1784583961.145142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+48:12303:x1871271580219776:12345-192.168.203.51@tcp:101:stat.0 Request processed in 18259us (18591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.145150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 171 00000100:00100000:2.0:1784583961.231404:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.233527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580220416 00000100:00100000:0.0:1784583961.233540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580220416 00000100:00100000:0.0:1784583961.233614:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 172 00000100:00100000:0.0:1784583961.233635:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+48:12309:x1871271580220416:12345-192.168.203.51@tcp:36:truncate.0 00010000:00010000:0.0:1784583961.233694:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583961.233720:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e484b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e7 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.233739:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583961.233744:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583961.233919:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.233932:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.233942:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583961.233999:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:0.0:1784583961.234021:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000678f184b reply state 0000000088873184 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.234033:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.234039:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583961.234041:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784583961.234044:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583961.234154:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:12309:x1871271580220416:12345-192.168.203.51@tcp:36:truncate.0 Request processed in 531us (2758us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1784583961.234162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 172 00000020:00080000:0.0:1784583961.234167:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784583961.450156:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.450249:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580220544 00000100:00100000:3.0:1784583961.450258:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580220544 00000100:00100000:3.0:1784583961.450316:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:3.0:1784583961.450327:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+50:12323:x1871271580220544:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:3.0:1784583961.450350:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583961.450371:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4ee expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450492:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450507:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450518:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450530:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450537:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450544:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450608:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450617:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450632:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.450672:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1784583961.450676:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583961.450697:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450709:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450717:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450724:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450730:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450736:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583961.450741:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450749:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450760:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583961.450762:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583961.450766:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450782:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e484ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450796:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450801:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450806:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450811:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583961.450813:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450818:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450826:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:3.0:1784583961.450829:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583961.450831:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450836:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450860:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 52 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450871:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 51 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.450884:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.450886:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583961.450889:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583961.450958:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:12323:x1871271580220544:12345-192.168.203.51@tcp:101:stat.0 Request processed in 633us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583961.450965:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:2.0:1784583961.556243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.556390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580220800 00000100:00100000:3.0:1784583961.556411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580220800 00000100:00100000:3.0:1784583961.556515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:3.0:1784583961.556527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:12333:x1871271580220800:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583961.556547:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583961.556567:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4f5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.556660:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784583961.556756:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4f5 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.556771:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:3.0:1784583961.556774:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583961.556779:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4f5 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.556794:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96c00, rc 0) 00000100:00100000:3.0:1784583961.556862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+52:12333:x1871271580220800:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 338us (629us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1784583961.556886:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:2.0:1784583961.565587:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.565667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221056 00000100:00100000:3.0:1784583961.565678:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221056 00000100:00100000:3.0:1784583961.565733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:3.0:1784583961.565742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+52:12333:x1871271580221056:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583961.565957:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:12333:x1871271580221056:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 215us (379us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784583961.565965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:2.0:1784583961.674925:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.675019:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221312 00000100:00100000:3.0:1784583961.675029:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221312 00000100:00100000:3.0:1784583961.675100:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:3.0:1784583961.675111:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+53:12339:x1871271580221312:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583961.675137:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583961.675161:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee4fc expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.675281:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.675296:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.675305:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.675342:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.675374:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 54 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583961.675387:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304869c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599152256:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583961.675674:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583961.682859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.683008:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304869c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599152256:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583961.683034:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583961.683101:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221440 00000100:00100000:1.0:1784583961.683108:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221440 00010000:00010000:1.0:1784583961.683144:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 55 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583961.683217:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:1.0:1784583961.683226:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:2400:x1871271580221440:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583961.683254:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583961.683261:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 55 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683273:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 55 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e484dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4ee expref: 55 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683309:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583961.683313:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683323:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683330:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.683358:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583961.683414:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:2400:x1871271580221440:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 188us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.683422:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00010000:00010000:3.0:1784583961.683496:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.683504:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.683521:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1784583961.683654:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e484f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 55 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.683669:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 54 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.683677:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.683680:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583961.683682:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583961.683705:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:12339:x1871271580221312:12345-192.168.203.51@tcp:101:bash.0 Request processed in 8597us (8791us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784583961.683745:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:2.0:1784583961.688959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.689313:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221696 00000100:00100000:3.0:1784583961.689324:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221696 00000100:00100000:3.0:1784583961.689386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:3.0:1784583961.689396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:12339:x1871271580221696:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1784583961.689680:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.689700:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.689711:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583961.689748:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1784583961.690043:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd5a4617 reply state 0000000056eb6f60 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.690059:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.690066:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.690068:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583961.690072:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583961.690227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:12339:x1871271580221696:12345-192.168.203.51@tcp:36:bash.0 Request processed in 827us (1272us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1784583961.690236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 176 00000020:00080000:3.0:1784583961.690241:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784583961.701831:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.701871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.701903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.701929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.701958:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221824 00000100:00100000:0.0:1784583961.701967:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221824 00000100:00100000:0.0:1784583961.702013:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 383 00000100:00100000:0.0:1784583961.702023:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580221824:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583961.702086:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b407d85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580221824:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.702106:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 383 00000100:00100000:0.0:1784583961.702151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.702173:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222208 00000100:00100000:0.0:1784583961.702200:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222208 00000100:00100000:0.0:1784583961.702235:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222080 00000100:00100000:0.0:1784583961.702238:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222080 00000100:00100000:0.0:1784583961.702261:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:0.0:1784583961.702269:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580222208:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583961.702300:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580222208:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.702307:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:0.0:1784583961.702319:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:0.0:1784583961.702325:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580222080:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583961.702350:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580222080:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.702356:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00080000:0.0:1784583961.702375:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583961.702380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784583961.702432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.702511:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583961.702560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580221952 00000100:00100000:0.0:1784583961.702564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580221952 00000100:00100000:1.0:1784583961.702692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222464 00000100:00100000:1.0:1784583961.702697:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222464 00000100:00100000:1.0:1784583961.702720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222336 00000100:00100000:1.0:1784583961.702723:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222336 00000100:00100000:1.0:1784583961.702737:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222592 00000100:00100000:1.0:1784583961.702747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222592 00000100:00100000:1.0:1784583961.702768:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 312 00000100:00100000:1.0:1784583961.702774:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580222464:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583961.702809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580222464:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.702816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 312 00000100:00100000:1.0:1784583961.702828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 313 00000100:00100000:1.0:1784583961.702835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580222336:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583961.702860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580222336:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.702865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 313 00000100:00100000:1.0:1784583961.702877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:1.0:1784583961.702882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:12339:x1871271580222592:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784583961.702894:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583961.702915:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4850d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee503 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.703002:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.703018:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 58 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.703027:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.703062:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 58 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.703084:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 58 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583961.703111:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30436f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599152384:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583961.703162:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32d80 going to sleep for 11 seconds 00000100:00080000:1.0:1784583961.703230:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583961.703233:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583961.704822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 314 00000100:00100000:0.0:1784583961.704845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580221952:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583961.704916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580221952:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 81us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.704923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 314 00000100:00100000:3.0:1784583961.710798:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.710877:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30436f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599152384:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583961.710903:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583961.710969:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222720 00000100:00100000:3.0:1784583961.710975:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222720 00010000:00010000:3.0:1784583961.711010:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 59 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583961.711051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:3.0:1784583961.711061:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:2400:x1871271580222720:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583961.711077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583961.711085:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 59 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711110:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 59 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711131:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e484f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4fc expref: 59 pid: 9809 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711147:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.711152:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711162:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711169:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711200:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583961.711248:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:2400:x1871271580222720:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583961.711255:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00010000:00010000:3.0:1784583961.711277:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711283:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.711334:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784583961.711339:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784583961.711360:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711390:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4850d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee503 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711405:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee503 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.711412:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.711415:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583961.711418:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:3.0:1784583961.711456:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:12339:x1871271580222592:12345-192.168.203.51@tcp:101:bash.0 Request processed in 8573us (8944us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583961.711463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:3.0:1784583961.716368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583961.716548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580222976 00000100:00100000:2.0:1784583961.716558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580222976 00000100:00100000:2.0:1784583961.716623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1784583961.716633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+57:12339:x1871271580222976:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1784583961.716989:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:12339:x1871271580222976:12345-192.168.203.51@tcp:35:bash.0 Request processed in 357us (630us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784583961.716997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000001:00080000:3.0:1784583961.721858:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:3.0:1784583961.721898:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1784583961.721921:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b402aace40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1784583961.721926:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea47500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b402aac900 00000020:00080000:3.0:1784583961.721930:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea47600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b40d6f4600 00000020:00080000:2.0:1784583961.722218:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1784583961.722282:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784583961.722292:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784583961.722311:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599152512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784583961.722381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583961.722590:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599152512 00000100:00100000:0.0:1784583961.722598:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599152512 00000100:00100000:0.0:1784583961.722658:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784583961.722667:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599152512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784583961.722692:0:11860:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1784583961.722729:0:11860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a5e9718, atime: 0x6a5e9718, ctime: 0x6a5e9718, blocks: 0x8 00010000:00010000:0.0:1784583961.722738:0:11860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.722754:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1784583961.722759:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583961.722766:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.722792:0:11860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.722803:0:11860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.722810:0:11860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583961.722825:0:11860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784583961.722938:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1871271599152512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (557us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784583961.722946:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1784583961.723325:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723335:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723341:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723347:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723352:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723360:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723376:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98b43e8a9d00) 00010000:00010000:1.0:1784583961.723379:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723384:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723390:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e48354 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723418:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723425:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723431:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723447:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723450:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723457:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723465:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:1.0:1784583961.723503:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723506:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723512:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e4835b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723526:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723532:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723538:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723550:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723553:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723560:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723569:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0e00) 00010000:00010000:1.0:1784583961.723571:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723674:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723683:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e4839a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723700:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723706:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723711:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723716:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723719:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723725:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723744:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583961.723747:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723750:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723755:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e4849d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723827:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723835:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723841:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723846:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723849:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723855:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723864:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583961.723867:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723869:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723874:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e484c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723896:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723902:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723908:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723913:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583961.723916:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723921:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723929:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583961.723931:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583961.723934:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583961.723939:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48506 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.725953:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583961.725968:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.725983:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784583961.725987:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.725997:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.726016:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.726024:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e4851b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.726050:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583961.726052:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583961.726054:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784583961.726115:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43ef19180/2, rc 0, transno 4294967308 00000100:00100000:2.0:1784583961.726124:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599152512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784583961.773817:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599152640:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774276:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599153152:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774316:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599153664:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774354:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30436ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599154176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583961.774373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774387:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784583961.774392:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599152768:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774421:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599153280:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774445:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599153792:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.774507:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153152 00000100:00100000:2.0:1784583961.774513:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153152 00000100:00100000:2.0:1784583961.774552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784583961.774559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599153152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.774623:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599153152:12345-0@lo:400:kworker.0 Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.774630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784583961.774648:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154176 00000100:00100000:2.0:1784583961.774651:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154176 00000100:00100000:2.0:1784583961.774670:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784583961.774675:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599154176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583961.774700:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583961.774728:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599154176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.774733:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784583961.774753:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153664 00000100:00100000:2.0:1784583961.774756:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153664 00000100:00100000:1.0:1784583961.775336:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599152640 00000100:00100000:1.0:1784583961.775342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599152640 00000100:00100000:1.0:1784583961.775373:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784583961.775379:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599152640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.775418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599152640:12345-0@lo:400:kworker.0 Request processed in 40us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.775435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784583961.775483:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599152768 00000100:00100000:1.0:1784583961.775487:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599152768 00000100:00100000:1.0:1784583961.775510:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153280 00000100:00100000:1.0:1784583961.775513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153280 00000100:00100000:1.0:1784583961.775525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153792 00000100:00100000:1.0:1784583961.775527:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153792 00000100:00100000:1.0:1784583961.775541:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784583961.775546:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599152768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.775589:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599152768:12345-0@lo:400:kworker.0 Request processed in 43us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.775596:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784583961.775609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784583961.775625:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599153280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.775651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3039f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599153280:12345-0@lo:400:kworker.0 Request processed in 37us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.775657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784583961.775665:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784583961.775673:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599153792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583961.775708:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599153792:12345-0@lo:400:kworker.0 Request processed in 36us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.776049:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784583961.776060:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599153664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.776105:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599153664:12345-0@lo:400:kworker.0 Request processed in 49us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.776111:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1784583961.776131:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784583961.776135:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583961.776148:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583961.777107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.777173:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154304 00000100:00100000:2.0:1784583961.777180:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154304 00000100:00100000:2.0:1784583961.777394:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784583961.777402:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599154304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583961.777430:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784583961.777496:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4332c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599154304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.777502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1784583961.777518:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583961.777551:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583961.778103:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599152896:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778179:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599153408:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778228:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599153920:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778257:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599154432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583961.778277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778307:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784583961.778314:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599153024:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778343:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599153536:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778376:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599154048:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.778420:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153536 00000100:00100000:2.0:1784583961.778426:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153536 00000100:00100000:2.0:1784583961.778453:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154048 00000100:00100000:2.0:1784583961.778456:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154048 00000100:00100000:2.0:1784583961.778504:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583961.778510:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599153536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.778548:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599153536:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.778554:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784583961.778567:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784583961.778573:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599154048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583961.780512:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153408 00000100:00100000:0.0:1784583961.780520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153408 00000100:00100000:1.0:1784583961.784877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153920 00000100:00100000:1.0:1784583961.784891:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153920 00000100:00100000:1.0:1784583961.784935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599153024 00000100:00100000:1.0:1784583961.784938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599153024 00000100:00100000:1.0:1784583961.784954:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784583961.784962:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599153920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.785042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599153920:12345-0@lo:400:kworker.0 Request processed in 80us (6792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.785049:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784583961.785065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784583961.785217:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3040d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599154048:12345-0@lo:400:kworker.0 Request processed in 6643us (6818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.785228:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1784583961.785259:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784583961.785264:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583961.785277:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599152896 00000100:00100000:2.0:1784583961.785281:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599152896 00000100:00100000:2.0:1784583961.785318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784583961.785324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599152896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599152896:12345-0@lo:400:kworker.0 Request processed in 35us (7204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.785364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784583961.785392:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599154560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583961.785431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583961.785481:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154432 00000100:00100000:2.0:1784583961.785485:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154432 00000100:00100000:2.0:1784583961.785504:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154560 00000100:00100000:2.0:1784583961.785506:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154560 00000100:00100000:2.0:1784583961.785517:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784583961.785522:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599154432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583961.785536:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784583961.785564:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599154432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (7286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.785579:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784583961.785591:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784583961.785596:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599154560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583961.785604:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583961.785649:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599154560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.785655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784583961.785696:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599153536:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785706:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599154048:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785715:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599152896:0@lo:400:kworker.0 00010000:00080000:2.0:1784583961.785728:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303963100 x1871271599153920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583961.785737:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599153920:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785753:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599154432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583961.785799:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599154560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583961.785820:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599152768:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785830:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599153280:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785839:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599153792:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785854:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30436ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599154176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583961.785862:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599152640:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785871:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599153152:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.785879:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599153664:0@lo:400:kworker.0 00000100:00100000:3.0:1784583961.786183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784583961.787744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784583961.787766:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599153408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583961.787858:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599153408:12345-0@lo:400:kworker.0 Request processed in 103us (9642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583961.787876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:3.0:1784583961.788150:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43766ea00 x1871271599153408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583961.788164:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599153408:0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.792717:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30419d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599153024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583961.792837:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30419d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599153024:12345-0@lo:400:kworker.0 Request processed in 7752us (14501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583961.792857:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784583961.794368:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599153024:0@lo:400:kworker.0 00000100:00100000:2.0:1784583961.828438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.828755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580223232 00000100:00100000:3.0:1784583961.828765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580223232 00000100:00100000:3.0:1784583961.828815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 178 00000100:00100000:3.0:1784583961.828825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+17:12349:x1871271580223232:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583961.828848:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583961.828935:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee50a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.829031:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784583961.829137:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48522 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee50a expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.829276:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:3.0:1784583961.829279:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583961.829285:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee50a expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.829299:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784583961.829362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12349:x1871271580223232:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 538us (934us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1784583961.829369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 178 00000100:00100000:3.0:1784583961.833679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583961.833817:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580223360 00000100:00100000:2.0:1784583961.833839:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580223360 00000100:00100000:2.0:1784583961.833909:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 179 00000100:00100000:2.0:1784583961.833919:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12349:x1871271580223360:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1784583961.833990:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834005:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834018:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834033:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834041:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834047:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834124:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834134:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834140:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583961.834184:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834207:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834213:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834220:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834226:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583961.834230:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834236:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834248:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583961.834250:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583961.834255:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834261:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48530 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834274:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834280:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834285:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834296:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583961.834299:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834304:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834313:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0400) 00010000:00010000:2.0:1784583961.834315:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583961.834318:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834324:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48537 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834338:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834344:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834350:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834356:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583961.834358:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834364:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834382:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583961.834385:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583961.834388:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.834393:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e4853e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583961.834516:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12349:x1871271580223360:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 596us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.834525:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 179 00010000:00010000:1.0:1784583961.838004:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583961.840133:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.840366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580223616 00000100:00100000:3.0:1784583961.840376:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580223616 00000100:00100000:3.0:1784583961.840434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:3.0:1784583961.840451:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12349:x1871271580223616:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583961.840689:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12349:x1871271580223616:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 239us (563us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784583961.840697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:0.0:1784583961.881060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.881152:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580223872 00000100:00100000:3.0:1784583961.881162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580223872 00000100:00100000:3.0:1784583961.881220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:3.0:1784583961.881230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12352:x1871271580223872:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583961.881254:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583961.881273:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48545 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee511 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881363:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881378:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881390:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881405:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881431:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881563:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4855a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881574:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4855a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881597:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4855a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583961.881607:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784583961.881678:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881685:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881698:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881717:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583961.881721:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881729:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881741:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583961.881744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583961.881749:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881756:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4854c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881769:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881776:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881782:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881787:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583961.881790:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881807:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881815:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583961.881818:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583961.881821:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881827:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48553 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881867:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e48545 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee511 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881880:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4855a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee511 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583961.881887:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583961.881889:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583961.881891:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583961.881954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12352:x1871271580223872:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 725us (903us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1784583961.881961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:3.0:1784583961.885382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583961.885524:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580224000 00000100:00100000:2.0:1784583961.885533:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580224000 00000100:00100000:2.0:1784583961.885604:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:2.0:1784583961.885615:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12352:x1871271580224000:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1784583961.885680:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885697:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885708:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885744:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885750:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885771:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885777:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583961.885782:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885789:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885801:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583961.885804:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784583961.885808:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.885815:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48568 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583961.885878:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12352:x1871271580224000:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 265us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.885886:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:2.0:1784583961.889012:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583961.889120:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580224256 00000100:00100000:3.0:1784583961.889130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580224256 00000100:00100000:3.0:1784583961.889194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1784583961.889204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12352:x1871271580224256:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583961.889499:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12352:x1871271580224256:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 295us (496us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1784583961.889507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:0.0:1784583961.892063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583961.896455:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580224384 00000100:00100000:2.0:1784583961.896483:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580224384 00000100:00100000:2.0:1784583961.896560:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1784583961.896571:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2401:x1871271580224384:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583961.896604:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583961.896630:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4855a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee511 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583961.896670:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:2.0:1784583961.896675:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583961.896744:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:2401:x1871271580224384:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 175us (4700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583961.896753:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1784583962.131824:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583962.132132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580224640 00000100:00100000:3.0:1784583962.132142:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580224640 00000100:00100000:3.0:1784583962.132201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:3.0:1784583962.132210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12370:x1871271580224640:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1784583962.132233:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583962.132251:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4856f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee518 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.132347:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48576 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.132362:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48576 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.132373:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48576 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583962.132383:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784583962.132810:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4856f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee518 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.132829:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48576 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee518 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.132838:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583962.132853:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784583962.132857:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96c00, rc 0) 00000100:00100000:3.0:1784583962.132921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12370:x1871271580224640:12345-192.168.203.51@tcp:101:cat.0 Request processed in 712us (1105us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784583962.132928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:1.0:1784583962.179769:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583962.179869:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580224768 00000100:00100000:2.0:1784583962.179879:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580224768 00000100:00100000:2.0:1784583962.179942:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:2.0:1784583962.179953:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12371:x1871271580224768:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583962.179975:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583962.179996:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee51f expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180060:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180073:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180084:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583962.180137:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784583962.180140:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583962.180157:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180182:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee51f expref: 25 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180215:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee51f expref: 24 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583962.180223:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583962.180226:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583962.180230:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0c00, rc 0) 00000100:00100000:2.0:1784583962.180293:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12371:x1871271580224768:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 342us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583962.180301:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:2.0:1784583962.188991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583962.189072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225152 00000100:00100000:3.0:1784583962.189083:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225152 00000100:00100000:3.0:1784583962.189150:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:3.0:1784583962.189160:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12371:x1871271580225152:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583962.189835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12371:x1871271580225152:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 673us (851us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1784583962.189845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:0.0:1784583962.193251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583962.193335:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225280 00000100:00100000:3.0:1784583962.193344:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225280 00000100:00100000:3.0:1784583962.193419:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784583962.193430:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12371:x1871271580225280:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:3.0:1784583962.193452:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784583962.193500:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e48514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee503 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.193524:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48576 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee518 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.193537:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e48411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4bd expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583962.193548:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583962.193566:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583962.193641:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12371:x1871271580225280:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583962.193649:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784583962.196196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583962.196897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225408 00000100:00100000:0.0:1784583962.196907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225408 00000100:00100000:0.0:1784583962.197003:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:0.0:1784583962.197013:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12371:x1871271580225408:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:0.0:1784583962.197139:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.197157:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.197169:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784583962.197278:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1784583962.197417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12371:x1871271580225408:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 404us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583962.197425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:2.0:1784583962.219033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583962.219206:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225536 00000100:00100000:0.0:1784583962.219216:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225536 00000100:00100000:0.0:1784583962.219276:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:0.0:1784583962.219300:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12373:x1871271580225536:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583962.219319:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583962.219338:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e48599 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee526 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219443:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219458:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219506:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219523:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219531:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219539:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219954:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219965:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.219972:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583962.220025:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784583962.220029:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583962.220048:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220060:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220069:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220075:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220081:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220101:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583962.220105:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220112:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220123:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583962.220126:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583962.220131:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220137:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220163:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220169:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220175:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220191:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583962.220194:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220200:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220207:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b301fd1d00) 00010000:00010000:0.0:1784583962.220209:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583962.220212:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220218:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e485a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220247:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9200/0xdab2421a42e48599 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 24 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220260:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 23 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583962.220278:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583962.220280:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583962.220283:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:0.0:1784583962.220388:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12373:x1871271580225536:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1089us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583962.220396:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:0.0:1784583962.285816:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583962.288765:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599154688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583962.288846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583962.289104:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599154688 00000100:00100000:2.0:1784583962.289112:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599154688 00000100:00100000:2.0:1784583962.289189:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784583962.289199:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599154688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583962.289237:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784583962.289289:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599154688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583962.289296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784583962.290010:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599154688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583962.862238:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784583963.057276:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784583963.057285:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784583963.057325:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784583963.057333:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784583963.057499:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420301f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599154816:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784583963.057605:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583963.073052:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420301f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599154816:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784583963.093968:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.095244:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225664 00000100:00100000:1.0:1784583963.095255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225664 00000100:00100000:1.0:1784583963.095326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00100000:1.0:1784583963.095336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580225664:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784583963.095364:0:6514:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784583963.095493:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580225664:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 158us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.095501:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00080000:3.0:1784583963.095522:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583963.107601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.108143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580225792 00000100:00100000:1.0:1784583963.108153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580225792 00000100:00100000:1.0:1784583963.108212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00100000:1.0:1784583963.108221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580225792:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784583963.108289:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108305:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108315:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108370:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108377:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108383:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108408:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108416:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108423:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583963.108464:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784583963.108486:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784583963.108497:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108508:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108515:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108522:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108538:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583963.108542:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108550:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108563:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:1.0:1784583963.108566:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583963.108571:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108577:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf000/0xdab2421a42e485b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108587:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108593:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108598:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108602:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cec00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583963.108605:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108610:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108629:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff98b303809b00) 00010000:00010000:1.0:1784583963.108631:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583963.108634:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108641:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cec00/0xdab2421a42e485bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108655:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108662:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108667:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108671:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583963.108674:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108679:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108693:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:1.0:1784583963.108695:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583963.108698:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.108704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e485c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583963.108787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580225792:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 565us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.108795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00100000:3.0:1784583963.111152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.111234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580226048 00000100:00100000:0.0:1784583963.111243:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580226048 00000100:00100000:0.0:1784583963.111301:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:0.0:1784583963.111311:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580226048:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583963.111332:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583963.111349:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee52d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111439:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111452:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111463:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583963.111496:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784583963.111574:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111583:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111589:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111594:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583963.111598:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111605:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111616:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583963.111619:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583963.111622:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.111629:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e485d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.112041:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee52d expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.112053:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:0.0:1784583963.112055:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583963.112059:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e485ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee52d expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.112089:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:0.0:1784583963.112174:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226048:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 865us (1030us total) trans 4294967460 rc 301/301 00000100:00100000:0.0:1784583963.112182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:1.0:1784583963.120745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.120859:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580226176 00000100:00100000:3.0:1784583963.120869:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580226176 00000100:00100000:3.0:1784583963.120938:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:3.0:1784583963.120949:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226176:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784583963.120995:0:9809:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784583963.121123:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226176:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.121132:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:2.0:1784583963.124718:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.124854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580226432 00000100:00100000:1.0:1784583963.124864:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580226432 00000100:00100000:1.0:1784583963.124938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:1.0:1784583963.124948:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226432:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583963.124969:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583963.124973:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784583963.125007:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4858b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee51f expref: 24 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.125026:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:1.0:1784583963.125030:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583963.125043:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e485df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee534 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784583963.125411:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1784583963.125607:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e485e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.125619:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e485e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.125628:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e485e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.125681:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cea00/0xdab2421a42e485df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee534 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.125697:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e485e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee534 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.125704:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b4092c0100) 00010000:00010000:2.0:1784583963.125707:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583963.125709:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1200, rc 0) 00000100:00100000:2.0:1784583963.125770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12384:x1871271580226432:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 822us (1058us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1784583963.125777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:3.0:1784583963.138192:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.138226:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580226688 00000100:00100000:3.0:1784583963.138234:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580226688 00000100:00100000:3.0:1784583963.138284:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:3.0:1784583963.138292:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12384:x1871271580226688:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784583963.138345:0:9809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583963.138371:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e485e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee534 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138388:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b4092c0100) 00010000:00010000:3.0:1784583963.138399:0:9809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583963.138443:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138457:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138493:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138509:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138515:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138521:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138565:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138572:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138578:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138596:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.138600:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138606:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138626:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583963.138628:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583963.138632:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138638:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e485f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138647:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138653:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138659:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138664:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.138667:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138672:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138679:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xda13f1a6 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583963.138681:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583963.138683:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.138689:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e485fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda13f1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.138772:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226688:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 480us (588us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784583963.138780:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:3.0:1784583963.141405:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.141454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580226816 00000100:00100000:3.0:1784583963.141462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580226816 00000100:00100000:3.0:1784583963.141533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 192 00000100:00100000:3.0:1784583963.141541:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12384:x1871271580226816:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583963.141559:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583963.141578:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee53b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141622:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141635:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141645:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141748:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141766:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.141785:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784583963.141787:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583963.141791:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583963.141838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12384:x1871271580226816:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 298us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.141845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 192 00000100:00100000:3.0:1784583963.147016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.147098:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227072 00000100:00100000:1.0:1784583963.147108:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227072 00000100:00100000:1.0:1784583963.147168:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1784583963.147178:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12384:x1871271580227072:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784583963.147256:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.147287:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.147300:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784583963.147460:0:9809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1784583963.147496:0:9809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406333027896ns, next at 407333025689ns, rc = 0 00000004:00010000:1.0:1784583963.147543:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006696e9bd reply state 000000004a622b09 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.147556:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.147564:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784583963.147567:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784583963.147570:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784583963.147671:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12384:x1871271580227072:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 493us (663us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1784583963.147680:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:2.0:1784583963.153794:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.153885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227200 00000100:00100000:3.0:1784583963.153896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227200 00000100:00100000:3.0:1784583963.153954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:3.0:1784583963.153963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12384:x1871271580227200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583963.153986:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583963.154005:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee542 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.154061:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.154076:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.154104:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784583963.154107:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583963.154111:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:3.0:1784583963.154175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12384:x1871271580227200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 212us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.154191:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:3.0:1784583963.161553:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.161694:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227328 00000100:00100000:0.0:1784583963.161704:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227328 00000100:00100000:0.0:1784583963.161783:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:0.0:1784583963.161794:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580227328:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784583963.162140:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580227328:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 347us (593us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784583963.162160:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00080000:1.0:1784583963.162379:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583963.179626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.180627:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227584 00000100:00100000:0.0:1784583963.180639:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227584 00000100:00100000:0.0:1784583963.180710:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784583963.180722:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12384:x1871271580227584:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784583963.180934:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12384:x1871271580227584:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 213us (1315us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784583963.180942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000040:00080000:3.0:1784583963.190723:0:14648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583963.190734:0:14648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784583963.190757:0:14648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784583963.190765:0:14648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583963.202650:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.202784:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227840 00000100:00100000:3.0:1784583963.202793:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227840 00000100:00100000:3.0:1784583963.202852:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:3.0:1784583963.202863:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12384:x1871271580227840:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784583963.202965:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12384:x1871271580227840:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.202973:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:3.0:1784583963.206303:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.206380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580227968 00000100:00100000:0.0:1784583963.206391:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580227968 00000100:00100000:0.0:1784583963.206482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:0.0:1784583963.206493:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12384:x1871271580227968:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583963.206526:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583963.206547:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4861e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee549 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206757:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206773:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206785:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583963.206827:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583963.206845:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206869:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4861e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee549 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206885:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee549 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.206893:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:0.0:1784583963.206896:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784583963.206899:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9400, rc 0) 00000100:00100000:0.0:1784583963.206951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12384:x1871271580227968:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 460us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.206958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:3.0:1784583963.210236:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583963.210303:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228096 00000100:00100000:2.0:1784583963.210313:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228096 00000100:00100000:2.0:1784583963.210373:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:2.0:1784583963.210383:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580228096:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583963.210412:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583963.210442:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee550 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784583963.210494:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e971b, blocks: 0x0 00010000:00010000:2.0:1784583963.210513:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1784583963.210518:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784583963.210529:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.210546:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583963.210557:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0c00, rc 0) 00000100:00100000:2.0:1784583963.211503:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580228096:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1117us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583963.211512:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:0.0:1784583963.220446:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.220851:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228352 00000100:00100000:3.0:1784583963.220859:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228352 00000100:00100000:3.0:1784583963.220917:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 197 00000100:00100000:3.0:1784583963.220929:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12384:x1871271580228352:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784583963.221220:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12384:x1871271580228352:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 293us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.221228:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 197 00000100:00100000:3.0:1784583963.227537:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.228109:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228480 00000100:00100000:0.0:1784583963.228119:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228480 00000100:00100000:0.0:1784583963.228174:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:0.0:1784583963.228182:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:12384:x1871271580228480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583963.228198:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583963.228213:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee557 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.228250:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.228258:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583963.228261:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583963.228271:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.228300:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.228312:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.228327:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1871271599154944:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583963.228423:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583963.236445:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1871271599154944:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583963.236600:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.236622:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9c00, rc 0) 00000100:00100000:0.0:1784583963.236710:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:12384:x1871271580228480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 8528us (9178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.236719:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:0.0:1784583963.262437:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.262620:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228608 00000100:00100000:3.0:1784583963.262630:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228608 00010000:00010000:3.0:1784583963.262669:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.262710:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:3.0:1784583963.262719:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2400:x1871271580228608:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583963.262733:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583963.262754:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.262767:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.262790:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4862c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee550 expref: 9 pid: 8426 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.262803:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583963.262807:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583963.262815:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.262825:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.262860:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.262873:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1871271599155072:192.168.203.51@tcp:105: 00000100:00100000:3.0:1784583963.262947:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784583963.282236:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1871271599155072:192.168.203.51@tcp:105: 00010000:00010000:2.0:1784583963.282260:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583963.282314:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580228608:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 19595us (19884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583963.282325:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:1.0:1784583963.288625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583963.288788:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228736 00000100:00100000:2.0:1784583963.288797:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228736 00002000:00100000:2.0:1784583963.288844:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98b30436c700 x1871271580228736/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:289/0 lens 504/0 e 0 to 0 dl 1784583974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784583963.288872:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30436c700 with x1871271580228736 ext(0->8) 00002000:00010000:2.0:1784583963.288878:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30436c700 00000100:00100000:2.0:1784583963.288911:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1784583963.288920:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580228736:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784583963.290288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2401:x1871271580228736:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 1361us (1665us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784583963.290301:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00002000:00100000:2.0:1784583963.290311:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98b30436c700 x1871271580228736/t4294967315(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:289/0 lens 504/448 e 0 to 0 dl 1784583974 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784583963.290321:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30436c700 with x1871271580228736 ext(0->8) 00002000:00010000:2.0:1784583963.290326:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30436c700 00000100:00100000:0.0:1784583963.296685:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583963.296752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228864 00000100:00100000:2.0:1784583963.296761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228864 00000100:00100000:2.0:1784583963.296817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 198 00000100:00100000:2.0:1784583963.296826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12384:x1871271580228864:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784583963.302173:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1784583963.302189:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1784583963.302219:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:1.0:1784583963.302310:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302322:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302330:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302345:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583963.302349:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302358:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302375:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784583963.302378:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784583963.302383:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.302389:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e48610 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583963.302665:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583963.302682:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599155200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784583963.302748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583963.302801:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599155200 00000100:00100000:2.0:1784583963.302808:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599155200 00000100:00100000:2.0:1784583963.302857:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784583963.302867:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599155200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784583963.303040:0:11860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784583963.303050:0:11860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784583963 00002000:00010000:2.0:1784583963.303052:0:11860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784583963.303055:0:11860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784583963 -> 1784583963 00002000:00010000:2.0:1784583963.303057:0:11860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1784583963.303107:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599155200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (358us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1784583963.303114:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1784583963.303134:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1784583963.303163:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b30405f800/2, rc 0, transno 4294967316 00000100:00100000:2.0:1784583963.303169:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599155200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784583963.303619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12384:x1871271580228864:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 6790us (6935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.303628:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 198 00000020:00080000:2.0:1784583963.304318:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1784583963.304331:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1784583963.305877:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583963.306059:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580228992 00000100:00100000:2.0:1784583963.306068:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580228992 00000100:00100000:2.0:1784583963.306130:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1784583963.306139:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2400:x1871271580228992:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784583963.315963:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1784583963.315985:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1784583963.318743:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580228992:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 12596us (12865us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.318756:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:1.0:1784583963.331389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.339103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580229248 00000100:00100000:3.0:1784583963.339120:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580229248 00000100:00100000:3.0:1784583963.346649:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 199 00000100:00100000:3.0:1784583963.346664:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12384:x1871271580229248:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784583963.346715:0:9809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583963.346740:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee549 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.346758:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784583963.346763:0:9809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583963.346789:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.346803:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.346812:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583963.346921:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d668765 reply state 00000000097832a6 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.346934:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.346954:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784583963.346957:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583963.346960:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583963.347380:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:12384:x1871271580229248:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 718us (15998us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1784583963.347388:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 199 00000100:00100000:3.0:1784583963.352009:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.352349:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580229376 00000100:00100000:1.0:1784583963.352358:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580229376 00000100:00100000:1.0:1784583963.352415:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:1.0:1784583963.352432:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580229376:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784583963.352615:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1784583963.352630:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784583963 -> 1784583962 00002000:00010000:1.0:1784583963.352633:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784583960 00002000:00010000:1.0:1784583963.352635:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784583963 -> 1784583962 00002000:00010000:1.0:1784583963.352638:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784583963.352692:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580229376:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 268us (692us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784583963.352700:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:2.0:1784583963.360842:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.360907:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580229632 00000100:00100000:0.0:1784583963.360916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580229632 00000100:00100000:0.0:1784583963.361062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 200 00000100:00100000:0.0:1784583963.361074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:12384:x1871271580229632:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784583963.361151:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.361169:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.361181:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.361213:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.361336:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.361365:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599155328:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583963.361461:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff600 going to sleep for 11 seconds 00000100:00100000:1.0:1784583963.364150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.364182:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580229760 00000100:00100000:1.0:1784583963.364190:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580229760 00000100:00100000:0.0:1784583963.364384:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599155328:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583963.364407:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.364454:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 21 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.364610:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1784583963.364621:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:2401:x1871271580229760:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583963.364635:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583963.364643:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 21 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364656:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 21 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364679:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee53b expref: 21 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364693:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:0.0:1784583963.364698:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364709:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364717:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364746:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583963.364792:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:2401:x1871271580229760:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 172us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.364800:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00010000:00010000:0.0:1784583963.364860:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364868:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364905:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364913:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364920:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364925:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583963.364929:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364937:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364947:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:0.0:1784583963.364949:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784583963.364953:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.364970:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e48641 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.365020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12384:x1871271580229632:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 3948us (4186us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784583963.367711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 200 00000100:00100000:0.0:1784583963.382121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.382161:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580229888 00000100:00100000:0.0:1784583963.382170:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580229888 00000100:00100000:0.0:1784583963.382217:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:0.0:1784583963.382240:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580229888:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784583963.382281:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.382303:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.382313:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583963.382317:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583963.382322:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.382359:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.382374:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.382398:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b420300380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599155456:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583963.382488:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784583963.387585:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.387617:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230016 00000100:00100000:0.0:1784583963.387625:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230016 00010000:00010000:0.0:1784583963.387663:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 9 pid: 8429 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.387698:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:0.0:1784583963.387708:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580230016:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583963.387722:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583963.387743:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 9 pid: 8429 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.387756:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 9 pid: 8429 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.387781:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583963.387786:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583963.387793:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.387803:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.387836:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583963.387880:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580230016:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 174us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.387888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 88 00010000:00010000:3.0:1784583963.388181:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee557 expref: 8 pid: 8429 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.388197:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b420300380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1871271599155456:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583963.388215:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388226:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388234:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388253:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388262:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388283:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388290:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583963.388294:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388304:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388317:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.388325:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e48648 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.389149:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580229888:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 6917us (7032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583963.389159:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:1.0:1784583963.403736:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583963.403783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230272 00000100:00100000:1.0:1784583963.403791:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230272 00000100:00100000:1.0:1784583963.403850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 201 00000100:00100000:1.0:1784583963.403859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12384:x1871271580230272:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784583963.403935:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.403951:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.403961:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.403994:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.404020:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 19 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583963.404034:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30436e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599155584:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583963.404116:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32840 going to sleep for 11 seconds 00000100:00100000:0.0:1784583963.410555:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.410581:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230400 00000100:00100000:0.0:1784583963.410588:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230400 00010000:00010000:0.0:1784583963.410624:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.410660:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:0.0:1784583963.410670:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:2400:x1871271580230400:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583963.410685:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583963.410692:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.410706:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.410727:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583963.410732:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.410742:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.410751:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.410781:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583963.410832:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:2400:x1871271580230400:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 163us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.410840:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00010000:00010000:3.0:1784583963.410942:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee4e0 expref: 19 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.410956:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30436e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599155584:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583963.410975:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.410991:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.410997:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.411157:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.411169:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.411178:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.411203:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.411216:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 19 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.411229:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599155712:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583963.411277:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784583963.423012:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583963.423437:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599155712:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583963.423580:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583963.423727:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230528 00000100:00100000:1.0:1784583963.423734:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230528 00010000:00010000:1.0:1784583963.423769:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583963.423803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1784583963.423813:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:2401:x1871271580230528:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583963.423827:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583963.423834:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423846:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423867:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee542 expref: 20 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423880:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784583963.423884:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423905:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423912:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.423930:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583963.423976:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:2401:x1871271580230528:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 164us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.423983:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00010000:00010000:3.0:1784583963.424031:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.424043:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583963.424154:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1784583963.424262:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1784583963.424299:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1784583963.424369:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599155840:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784583963.424416:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583963.424532:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784583963.426609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599155840 00000100:00100000:1.0:1784583963.426619:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599155840 00000100:00100000:1.0:1784583963.426673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784583963.426682:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599155840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784583963.426791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b420300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599155840:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583963.426799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784583963.426942:0:6515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1784583963.426948:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b30405f800, transno 4294967316 00000100:00100000:3.0:1784583963.426959:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599155840:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1784583963.427104:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1784583963.427166:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599155968:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784583963.427200:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583963.427222:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583963.427235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599155968 00000100:00100000:3.0:1784583963.427239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599155968 00000100:00100000:3.0:1784583963.427256:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784583963.427262:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599155968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784583963.427354:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1871271599155968:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (153us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784583963.427361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784583963.427390:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30423a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599155968:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784583963.427421:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427456:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427482:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427489:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.427494:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427501:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427515:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784583963.427518:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583963.427522:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427527:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48656 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427548:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427554:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427559:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427564:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.427573:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427692:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427703:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583963.427705:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583963.427708:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427714:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e48592 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427737:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427750:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 22 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427757:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427779:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 22 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.427791:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 22 pid: 9809 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.427803:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599156096:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583963.427851:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aacc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583963.436856:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599156096:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583963.436887:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583963.439112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.439186:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230656 00000100:00100000:0.0:1784583963.439195:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230656 00010000:00010000:0.0:1784583963.439235:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 23 pid: 9809 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583963.439278:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:0.0:1784583963.439288:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:2400:x1871271580230656:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583963.439307:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583963.439315:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 23 pid: 9809 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439329:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 23 pid: 9809 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439352:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e485ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee526 expref: 23 pid: 9809 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439365:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:0.0:1784583963.439368:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439375:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439395:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583963.439428:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583963.439501:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2400:x1871271580230656:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 214us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583963.439509:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 91 00010000:00010000:3.0:1784583963.439570:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439578:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439668:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439675:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439682:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439688:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.439693:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439700:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439710:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583963.439713:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583963.439716:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439722:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4865d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439741:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439747:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439754:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439759:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583963.439762:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439769:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439777:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b4092c0900) 00010000:00010000:3.0:1784583963.439779:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583963.439782:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.439787:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e4864f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.439963:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12384:x1871271580230272:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 36104us (36235us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784583963.439981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 201 00000020:00080000:3.0:1784583963.439985:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784583963.440675:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784583963.440681:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784583963.441164:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1784583963.441173:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784583963.446261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583963.446317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580230912 00000100:00100000:0.0:1784583963.446328:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580230912 00000100:00100000:3.0:1784583963.446451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784583963.446497:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12384:x1871271580230912:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784583963.447113:0:6517:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784583963.447147:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1784583963.447180:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447196:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447207:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447216:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447222:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447229:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583963.447247:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784583963.447285:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583963.447293:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.447303:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583963.447308:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.447317:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583963.447338:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12384:x1871271580230912:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 873us (1083us total) trans 4294967471 rc 0/0 00010000:00010000:1.0:1784583963.447340:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784583963.447345:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1784583963.447352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00010000:00010000:1.0:1784583963.447352:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784583963.447359:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784583963.447362:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48664 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583963.447376:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583963.447379:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583963.447381:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583963.885752:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583964.912724:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784583965.352195:0:14701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784583965.352205:0:14701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784583965.352238:0:14701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784583965.352245:0:14701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784583965.360829:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599156224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583965.360911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583965.360985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599156224 00000100:00100000:3.0:1784583965.360993:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599156224 00000100:00100000:3.0:1784583965.361040:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784583965.361049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599156224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583965.362774:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583965.362861:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599156224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1811us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583965.362871:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784583965.362939:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599156224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784583965.507057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.507139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580231168 00000100:00100000:3.0:1784583965.507149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580231168 00000100:00100000:3.0:1784583965.507227:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 202 00000100:00100000:3.0:1784583965.507238:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:12403:x1871271580231168:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583965.507263:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583965.507285:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4866b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee55e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.507395:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48672 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.507410:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.507430:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583965.507441:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784583965.507587:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4866b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee55e expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.507605:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee55e expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.507613:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583965.507616:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583965.507620:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96c00, rc 0) 00000100:00080000:1.0:1784583965.507812:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583965.507912:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12403:x1871271580231168:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 675us (864us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784583965.507921:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 202 00000100:00100000:0.0:1784583965.513293:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.513362:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580231296 00000100:00100000:3.0:1784583965.513372:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580231296 00000100:00100000:3.0:1784583965.513444:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:3.0:1784583965.513454:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12403:x1871271580231296:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1784583965.513857:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.513874:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.513884:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.513899:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.513906:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.513928:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514002:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514011:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514018:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784583965.514059:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514083:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514090:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514096:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514102:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.514106:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514114:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514126:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583965.514135:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.514140:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514147:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514161:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514167:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514173:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514178:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.514181:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514187:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514194:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.514197:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.514199:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514205:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514219:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514230:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514235:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514241:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.514244:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514250:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514257:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab200) 00010000:00010000:3.0:1784583965.514260:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.514263:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.514269:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e4868e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583965.514356:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12403:x1871271580231296:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 900us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583965.514364:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:2.0:1784583965.575810:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.575894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580231552 00000100:00100000:3.0:1784583965.575904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580231552 00000100:00100000:3.0:1784583965.575967:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:3.0:1784583965.575977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12406:x1871271580231552:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583965.576000:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583965.576031:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48695 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee565 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576118:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576132:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576143:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576157:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576164:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576170:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576274:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576283:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576291:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583965.576301:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784583965.576371:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576390:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576397:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.576403:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.576408:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578522:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578543:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583965.578546:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.578551:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578558:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e4869c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578641:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578649:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578656:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578719:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.578731:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578739:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578748:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:3.0:1784583965.578750:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.578754:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578761:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e486a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578818:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578834:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.578841:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.578844:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583965.578846:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583965.578920:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12406:x1871271580231552:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2944us (3119us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1784583965.578929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:0.0:1784583965.587530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.587613:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580231680 00000100:00100000:3.0:1784583965.587624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580231680 00000100:00100000:3.0:1784583965.587697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:3.0:1784583965.587707:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12406:x1871271580231680:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1784583965.587788:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587806:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587819:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587859:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587867:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587875:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587881:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216b000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.587885:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587892:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587903:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.587905:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784583965.587910:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.587915:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583965.587994:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4049b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12406:x1871271580231680:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 288us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583965.588001:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:2.0:1784583965.596977:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.597521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580231936 00000100:00100000:3.0:1784583965.597531:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580231936 00000100:00100000:3.0:1784583965.597755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1784583965.597765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12406:x1871271580231936:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583965.597974:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12406:x1871271580231936:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 209us (1006us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1784583965.597981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:1.0:1784583965.639897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583965.640017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232192 00000100:00100000:2.0:1784583965.640026:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232192 00000100:00100000:2.0:1784583965.640113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:2.0:1784583965.640123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:11930:x1871271580232192:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583965.640149:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583965.640170:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee56c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.640270:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.640285:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.640294:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.640332:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.640346:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 29 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583965.640359:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599156352:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583965.640446:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583965.646536:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583965.646686:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599156352:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583965.646714:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583965.646853:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232320 00000100:00100000:1.0:1784583965.646861:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232320 00010000:00010000:1.0:1784583965.646898:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 30 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583965.646940:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:1.0:1784583965.646950:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:2398:x1871271580232320:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583965.646967:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583965.646973:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 30 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.646985:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 30 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.647040:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e486aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee565 expref: 30 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.647057:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:1.0:1784583965.647062:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.647081:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.647089:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.647110:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583965.647162:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:2398:x1871271580232320:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 213us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583965.647170:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 92 00010000:00010000:3.0:1784583965.647640:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.647649:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583965.647680:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784583965.647818:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.647836:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.647844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.647846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583965.647858:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1a00, rc 0) 00000100:00100000:3.0:1784583965.647900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:11930:x1871271580232192:12345-192.168.203.51@tcp:101:bash.0 Request processed in 7778us (8012us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1784583965.647908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:3.0:1784583965.652301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583965.652998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232448 00000100:00100000:0.0:1784583965.653009:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232448 00000100:00100000:0.0:1784583965.653114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:0.0:1784583965.653125:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:11930:x1871271580232448:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583965.653149:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583965.653169:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e486d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee573 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653206:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e486db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653221:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e486db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653233:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e486db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653363:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e486d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee573 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653391:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e486db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee573 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.653400:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:0.0:1784583965.653403:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784583965.653406:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:0.0:1784583965.653503:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11930:x1871271580232448:12345-192.168.203.51@tcp:101:bash.0 Request processed in 380us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583965.653511:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:1.0:1784583965.658556:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.658950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232704 00000100:00100000:3.0:1784583965.658960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232704 00000100:00100000:3.0:1784583965.659023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 208 00000100:00100000:3.0:1784583965.659033:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:11930:x1871271580232704:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1784583965.659276:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.659295:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.659308:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583965.659349:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1784583965.659373:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a172961 reply state 000000006bb9c63a transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.659385:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.659393:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.659396:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583965.659399:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784583965.659436:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1784583965.659837:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11930:x1871271580232704:12345-192.168.203.51@tcp:36:bash.0 Request processed in 802us (1298us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1784583965.659864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 208 00000020:00080000:3.0:1784583965.659870:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1784583965.669762:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.669927:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232832 00000100:00100000:3.0:1784583965.669937:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232832 00000100:00100000:3.0:1784583965.670005:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:3.0:1784583965.670016:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+34:11930:x1871271580232832:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583965.670042:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583965.670073:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee57a expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.670135:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee57a expref: 35 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.670151:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee57a expref: 35 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.670170:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.670174:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583965.670177:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b44216b000, rc 0) 00000100:00100000:3.0:1784583965.670242:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:11930:x1871271580232832:12345-192.168.203.51@tcp:101:bash.0 Request processed in 227us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583965.670250:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:0.0:1784583965.678208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583965.678865:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580232960 00000100:00100000:1.0:1784583965.678876:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580232960 00000100:00100000:1.0:1784583965.679122:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:1.0:1784583965.679133:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:11930:x1871271580232960:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784583965.679152:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583965.679174:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee581 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784583965.679221:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a5e971a, atime: 0x6a5e9718, ctime: 0x6a5e971a, blocks: 0x8 00010000:00010000:1.0:1784583965.679244:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1784583965.679258:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784583965.679269:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.679283:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583965.679296:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf800, rc 0) 00000100:00100000:1.0:1784583965.679366:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:11930:x1871271580232960:12345-192.168.203.51@tcp:101:bash.0 Request processed in 235us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583965.679373:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00080000:2.0:1784583965.680126:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583965.685775:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.686043:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233088 00000100:00100000:3.0:1784583965.686053:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233088 00002000:00010000:3.0:1784583965.686107:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1784583965.686112:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30436d880 with x1871271580233088 ext(0->18446744073709551615) 00002000:00010000:3.0:1784583965.686125:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30436d880. 00000100:00100000:3.0:1784583965.686181:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1784583965.686191:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2399:x1871271580233088:12345-192.168.203.51@tcp:10:bash.0 00002000:00010000:3.0:1784583965.686454:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784583965.686458:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784583962 -> 1784583966 00002000:00010000:3.0:1784583965.686460:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1784583960 -> 1784583960 00002000:00010000:3.0:1784583965.686462:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784583962 -> 1784583966 00002000:00010000:3.0:1784583965.686464:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1784583965.686548:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2399:x1871271580233088:12345-192.168.203.51@tcp:10:bash.0 Request processed in 357us (1826us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1784583965.686556:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00002000:00010000:3.0:1784583965.686560:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1784583965.686563:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b30436d880 with x1871271580233088 ext(0->18446744073709551615) 00002000:00010000:3.0:1784583965.686567:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b30436d880. 00000100:00100000:3.0:1784583965.791299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583965.791404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233216 00000100:00100000:2.0:1784583965.791425:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233216 00000100:00100000:2.0:1784583965.791521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:2.0:1784583965.791531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:12420:x1871271580233216:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1784583965.791618:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791637:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791649:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791664:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791671:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791677:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791753:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791763:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791769:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583965.791815:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791850:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791857:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791864:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791869:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583965.791873:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791880:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791891:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583965.791894:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583965.791898:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791903:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e486f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791922:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791927:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791938:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583965.791941:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791947:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791954:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b4092c0500) 00010000:00010000:2.0:1784583965.791956:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583965.791959:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791964:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0600/0xdab2421a42e486fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791978:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791983:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791988:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.791994:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583965.791997:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.792002:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.792020:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:2.0:1784583965.792022:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583965.792025:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.792030:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e48705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583965.792116:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:12420:x1871271580233216:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 585us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583965.792124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:0.0:1784583965.861016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.861110:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233472 00000100:00100000:3.0:1784583965.861121:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233472 00000100:00100000:3.0:1784583965.861182:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:3.0:1784583965.861193:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+35:12423:x1871271580233472:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583965.861215:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583965.861235:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4870c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee588 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861309:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861323:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861353:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861369:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861376:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861383:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861524:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48721 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861535:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861542:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583965.861552:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784583965.861637:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861644:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861651:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861657:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.861667:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861676:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861688:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583965.861691:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.861695:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861701:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48713 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861715:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861722:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861728:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861733:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583965.861737:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861743:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861750:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:3.0:1784583965.861753:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583965.861762:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861769:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4871a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861810:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e4870c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee588 expref: 38 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861825:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee588 expref: 37 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.861833:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583965.861836:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784583965.861839:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:2.0:1784583965.862109:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12423:x1871271580233472:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 917us (1100us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784583965.862118:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:3.0:1784583965.870559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583965.870817:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233600 00000100:00100000:2.0:1784583965.870835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233600 00000100:00100000:2.0:1784583965.870886:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:2.0:1784583965.870895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12423:x1871271580233600:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1784583965.870960:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.870976:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.870986:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.871017:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.871042:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 37 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583965.871056:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599156480:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583965.871144:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b43c0 going to sleep for 11 seconds 00000001:00080000:0.0:1784583965.873553:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1784583965.873571:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1784583965.874401:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599156480:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583965.874438:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583965.877992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583965.879982:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233856 00000100:00100000:0.0:1784583965.880009:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233856 00000100:00100000:0.0:1784583965.880084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1784583965.880095:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:6168:x1871271580233856:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784583965.880407:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:6168:x1871271580233856:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 312us (2422us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1784583965.880415:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1784583965.884542:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583965.884634:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580233984 00000100:00100000:0.0:1784583965.884644:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580233984 00010000:00010000:0.0:1784583965.884753:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 39 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583965.884798:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:0.0:1784583965.884822:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30436d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:2401:x1871271580233984:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583965.884838:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583965.884846:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 39 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.884858:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 39 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.884879:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e486c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee56c expref: 39 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.884895:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:0.0:1784583965.884964:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.885047:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.885055:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583965.885143:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583965.885203:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30436d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:2401:x1871271580233984:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 383us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583965.885211:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 93 00010000:00010000:3.0:1784583965.899153:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583965.899172:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899361:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899370:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899377:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899383:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583965.899387:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899395:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899412:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:2.0:1784583965.899415:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784583965.899419:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583965.899444:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4872f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583965.899561:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12423:x1871271580233600:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 28661us (29003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583965.899570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:1.0:1784583965.903371:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583965.903463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580234240 00000100:00100000:3.0:1784583965.903500:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580234240 00000100:00100000:3.0:1784583965.903552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1784583965.903561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+37:12423:x1871271580234240:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784583965.903806:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:12423:x1871271580234240:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 245us (443us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1784583965.903814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00010000:00010000:2.0:1784583965.933771:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583966.074661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.074930:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580234496 00000100:00100000:3.0:1784583966.074940:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580234496 00000100:00100000:3.0:1784583966.075000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:3.0:1784583966.075010:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+38:12434:x1871271580234496:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1784583966.075033:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583966.075053:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48736 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee58f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075139:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075154:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075165:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075180:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075192:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075198:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075306:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e4874b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075317:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e4874b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075342:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e4874b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583966.075353:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1784583966.075427:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075576:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075583:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075589:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583966.075593:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075600:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075613:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583966.075616:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583966.075620:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075627:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e4873d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075641:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075647:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075659:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075665:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583966.075669:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075675:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075683:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:3.0:1784583966.075686:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583966.075689:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075695:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e48744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075734:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48736 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee58f expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075747:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e4874b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee58f expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.075755:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583966.075758:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583966.075760:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982c00, rc 0) 00000100:00100000:3.0:1784583966.075874:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12434:x1871271580234496:12345-192.168.203.51@tcp:101:cat.0 Request processed in 864us (1222us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784583966.075892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:1.0:1784583966.089374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.089494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580234752 00000100:00100000:3.0:1784583966.089505:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580234752 00000100:00100000:3.0:1784583966.089559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:3.0:1784583966.089580:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+40:12434:x1871271580234752:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:3.0:1784583966.089872:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:12434:x1871271580234752:12345-192.168.203.51@tcp:35:cat.0 Request processed in 304us (507us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1784583966.089881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:1.0:1784583966.160935:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.161102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235008 00000100:00100000:3.0:1784583966.161113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235008 00000100:00100000:3.0:1784583966.161182:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00100000:3.0:1784583966.161193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+41:12435:x1871271580235008:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:3.0:1784583966.161254:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1784583966.161295:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b000/0xdab2421a42e486e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee57a expref: 41 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161321:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982c00/0xdab2421a42e4874b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee58f expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161337:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e48721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee588 expref: 39 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161351:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e486db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee573 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161363:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:3.0:1784583966.161381:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583966.161405:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161432:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161444:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161458:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161464:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161529:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161981:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161992:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.161999:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784583966.167779:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1784583966.167799:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409353330194ns, next at 410353327071ns, rc = 0 00010000:00010000:2.0:1784583966.168190:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168206:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168219:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168229:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168235:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168242:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168267:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784583966.168290:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168316:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168321:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168327:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.168331:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168338:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168350:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:2.0:1784583966.168353:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784583966.168357:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168363:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97200/0xdab2421a42e48767 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168382:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168387:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168393:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.168398:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583966.168783:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784583966.168791:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.168798:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583966.168808:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.168815:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.168824:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:2.0:1784583966.170475:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.170497:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.170513:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583966.170516:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.170520:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.170527:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e48759 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583966.170544:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e989e321 reply state 00000000e3ef8217 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.170556:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.170574:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:2.0:1784583966.170576:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784583966.170579:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784583966.170707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:12435:x1871271580235008:12345-192.168.203.51@tcp:36:rm.0 Request processed in 9510us (9775us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784583966.170716:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 214 00010000:00010000:3.0:1784583966.171200:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784583966.171207:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.171214:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e4876e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.171228:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583966.171231:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583966.171233:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583966.234457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.234627:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235264 00000100:00100000:2.0:1784583966.234637:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235264 00000100:00100000:2.0:1784583966.234752:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:2.0:1784583966.234764:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+39:12441:x1871271580235264:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583966.234788:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.234824:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48775 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee596 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234935:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234951:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234974:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234985:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234993:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.234998:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784583966.235325:0:9809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1784583966.235461:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235665:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235674:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235708:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235728:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235734:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235740:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.235744:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235752:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235764:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583966.235768:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.235772:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235778:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e4877c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784583966.235792:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e95ae08 reply state 000000006af872bd transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235803:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235809:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:2.0:1784583966.235812:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784583966.235815:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784583966.235840:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48775 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 42 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235861:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 41 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.235868:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:2.0:1784583966.235871:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583966.235872:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0a00, rc 0) 00000100:00100000:2.0:1784583966.236007:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:12441:x1871271580235264:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1244us (1558us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1784583966.236016:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:1.0:1784583966.244222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.244360:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235392 00000100:00100000:3.0:1784583966.244370:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235392 00000100:00100000:3.0:1784583966.244449:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1784583966.244463:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580235392:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583966.244540:0:11860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583966.244577:0:11860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee59d expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784583966.244608:0:11860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784583966.244631:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1784583966.244636:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583966.244647:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 6 pid: 11860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.244695:0:11860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 6 pid: 11860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.244712:0:11860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583966.244779:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2400:x1871271580235392:12345-192.168.203.51@tcp:101:bash.0 Request processed in 321us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.244786:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00080000:2.0:1784583966.245867:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583966.252741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.255037:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235520 00000100:00100000:3.0:1784583966.255050:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235520 00000100:00100000:3.0:1784583966.255184:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:3.0:1784583966.255195:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:12441:x1871271580235520:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784583966.255213:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583966.255231:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5a4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.255272:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.255282:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583966.255286:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583966.255292:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.255329:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.255358:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583966.255371:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1871271599156608:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583966.255508:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42030f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784583966.263359:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1871271599156608:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583966.263395:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.263415:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583966.263565:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:12441:x1871271580235520:12345-192.168.203.51@tcp:101:bash.0 Request processed in 8371us (11024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.263575:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:1.0:1784583966.275884:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.276412:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235648 00000100:00100000:0.0:1784583966.276423:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235648 00010000:00010000:0.0:1784583966.276510:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.276556:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:0.0:1784583966.276680:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580235648:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583966.276696:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583966.276717:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.276732:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.276754:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d76d83af/0xdab2421a42e48798 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee59d expref: 7 pid: 11860 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.276770:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583966.276775:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583966.276782:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.276791:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.276827:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.276854:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6501:1871271599156736:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583966.276985:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff540 going to sleep for 11 seconds 00000100:00100000:1.0:1784583966.284590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.284794:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6501:1871271599156736:192.168.203.51@tcp:105: 00010000:00010000:0.0:1784583966.284816:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583966.284870:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580235648:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 8305us (8995us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.284881:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:3.0:1784583966.286405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580235904 00000100:00100000:3.0:1784583966.286418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580235904 00000100:00100000:3.0:1784583966.286515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:3.0:1784583966.286525:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+42:12441:x1871271580235904:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1784583966.286905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12441:x1871271580235904:12345-192.168.203.51@tcp:35:bash.0 Request processed in 380us (2322us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1784583966.286915:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:1.0:1784583966.294005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.294052:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.294110:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236160 00000100:00100000:0.0:1784583966.294121:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236160 00000100:00100000:0.0:1784583966.294181:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:0.0:1784583966.294191:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580236160:12345-192.168.203.51@tcp:16:kworker.0 00000100:00100000:0.0:1784583966.294320:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580236160:12345-192.168.203.51@tcp:16:kworker.0 Request processed in 130us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.294327:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:2.0:1784583966.296123:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236032 00000100:00100000:2.0:1784583966.296139:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236032 00002000:00100000:2.0:1784583966.296208:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98b4376cdf80 x1871271580236032/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:292/0 lens 504/0 e 0 to 0 dl 1784583977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784583966.296220:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b4376cdf80 with x1871271580236032 ext(0->8) 00002000:00010000:2.0:1784583966.296226:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98b4376cdf80 00000100:00100000:2.0:1784583966.296266:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:2.0:1784583966.296276:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+6:2401:x1871271580236032:12345-192.168.203.51@tcp:4:bash.0 00000100:00100000:3.0:1784583966.299928:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580236032:12345-192.168.203.51@tcp:4:bash.0 Request processed in 3641us (5920us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784583966.299942:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00002000:00100000:3.0:1784583966.299965:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98b4376cdf80 x1871271580236032/t4294967309(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:292/0 lens 504/448 e 0 to 0 dl 1784583977 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784583966.299976:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b4376cdf80 with x1871271580236032 ext(0->8) 00002000:00010000:3.0:1784583966.299995:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98b4376cdf80 00000100:00100000:1.0:1784583966.429314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.432067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236288 00000100:00100000:2.0:1784583966.432083:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236288 00000100:00100000:2.0:1784583966.432248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:2.0:1784583966.432259:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+43:12457:x1871271580236288:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583966.432300:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.432322:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e487a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432386:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432429:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583966.432496:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784583966.432500:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583966.432519:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432540:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e487a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ab expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432557:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ab expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.432575:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583966.432578:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784583966.432581:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1c00, rc 0) 00000100:00100000:2.0:1784583966.432643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:12457:x1871271580236288:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 387us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.432650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:1.0:1784583966.436824:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.437016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236544 00000100:00100000:3.0:1784583966.437026:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236544 00000100:00100000:3.0:1784583966.437090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:3.0:1784583966.437101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+44:12457:x1871271580236544:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583966.437120:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583966.437141:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e487b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.437248:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e487bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.437262:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e487bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.437272:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e487bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583966.437284:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784583966.437384:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e487b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b2 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.437401:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e487bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b2 expref: 46 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.437410:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:3.0:1784583966.437413:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583966.437416:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583966.437509:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:12457:x1871271580236544:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 409us (693us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784583966.437530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:1.0:1784583966.444629:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.444676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.444854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236800 00000100:00100000:0.0:1784583966.444863:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236800 00000100:00100000:0.0:1784583966.445014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:0.0:1784583966.445024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+46:12457:x1871271580236800:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583966.445047:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583966.445075:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e487c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5b9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.445169:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.445201:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.445212:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583966.445225:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784583966.445309:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e487c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b9 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.445325:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b9 expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.445334:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:0.0:1784583966.445336:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784583966.445340:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8c00, rc 0) 00000100:00100000:2.0:1784583966.445498:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580236928 00000100:00100000:2.0:1784583966.445503:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580236928 00000100:00100000:2.0:1784583966.445539:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784583966.445546:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+49:2400:x1871271580236928:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583966.445556:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583966.445579:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e487bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b2 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.445590:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:2.0:1784583966.445593:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583966.445668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+48:12457:x1871271580236800:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 645us (1046us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1784583966.445675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:2.0:1784583966.449111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:2400:x1871271580236928:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 3552us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.449126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784583966.458438:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.458683:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237056 00000100:00100000:0.0:1784583966.458692:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237056 00000100:00100000:0.0:1784583966.458742:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:0.0:1784583966.458751:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2399:x1871271580237056:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:0.0:1784583966.458789:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.458808:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.458829:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583966.458833:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583966.458838:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.458882:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.458982:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 8 pid: 8428 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.459000:0:8805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1871271599156864:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583966.459089:0:8805:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583966.461228:0:8805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1871271599156864:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583966.461253:0:8805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583966.462957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.463249:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237184 00000100:00100000:2.0:1784583966.463259:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237184 00010000:00010000:2.0:1784583966.463297:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 9 pid: 8428 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583966.463344:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:2.0:1784583966.463354:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580237184:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583966.463370:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784583966.463388:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784583966.463391:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784583966 00002000:00010000:2.0:1784583966.463393:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784583966 00002000:00010000:2.0:1784583966.463395:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784583966.463401:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 9 pid: 8428 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.463448:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 9 pid: 8428 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.463488:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e92315/0xdab2421a42e4879f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5a4 expref: 9 pid: 8428 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.463505:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583966.463510:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583966.463527:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.463537:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.463570:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583966.463623:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580237184:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 270us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.463631:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 95 00010000:00010000:3.0:1784583966.463695:0:8805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463705:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463735:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463744:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463752:0:8805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463759:0:8805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784583966.463764:0:8805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463773:0:8805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463785:0:8805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.463804:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e487de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583966.463859:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2399:x1871271580237056:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 5108us (5429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.463868:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784583966.467108:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.467546:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237440 00000100:00100000:0.0:1784583966.467557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237440 00000100:00100000:0.0:1784583966.467619:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:0.0:1784583966.467628:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+47:12457:x1871271580237440:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:0.0:1784583966.467687:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b9 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583966.467918:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1784583966.467952:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1784583966.468258:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1784583966.468304:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.468321:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 51 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.468331:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.468367:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 51 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.468382:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 51 pid: 9809 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.468397:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599156992:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583966.469137:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784583966.472620:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1871271599156992:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583966.472666:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583966.473183:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.473443:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237568 00000100:00100000:2.0:1784583966.473453:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237568 00010000:00010000:2.0:1784583966.473541:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 52 pid: 9809 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583966.473576:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:2.0:1784583966.473585:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+52:2400:x1871271580237568:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583966.473624:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583966.473631:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 52 pid: 9809 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473644:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 52 pid: 9809 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473667:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4878a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee596 expref: 52 pid: 9809 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473686:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:2.0:1784583966.473691:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473702:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473711:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.473742:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583966.473795:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+51:2400:x1871271580237568:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 210us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.473804:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 96 00010000:00010000:3.0:1784583966.474128:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.474138:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583966.474250:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1784583966.474369:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1784583966.474500:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599157120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583966.474566:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583966.474605:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599157120 00000100:00100000:3.0:1784583966.474610:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599157120 00000100:00100000:3.0:1784583966.474658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784583966.474666:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599157120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583966.474729:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599157120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 64us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.474736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784583966.474757:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4066b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784583966.474774:0:6518:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1784583966.474779:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1784583966.474799:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43ef19180, transno 4294967308 00000100:00100000:3.0:1784583966.474810:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599157120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784583966.474904:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1784583966.474941:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599157248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583966.474968:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583966.474986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599157248 00000100:00100000:3.0:1784583966.474990:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599157248 00000100:00100000:3.0:1784583966.475013:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784583966.475020:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1871271599157248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784583966.475115:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1871271599157248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (146us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784583966.475121:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784583966.475138:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aacf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784583966.475153:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1871271599157248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784583966.475178:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1784583966.475202:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475210:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475217:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475223:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583966.475227:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475234:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475253:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:3.0:1784583966.475255:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784583966.475259:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.475265:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e487e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784583966.475344:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784583966.475400:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1784583966.475410:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409660942107ns, next at 410660939977ns, rc = 0 00000001:00080000:3.0:1784583966.475416:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1784583966.475436:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0500) 00010000:00010000:3.0:1784583966.475439:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784583966.475445:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e487d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5b9 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583966.475538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:12457:x1871271580237440:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 7910us (8438us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1784583966.475546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000020:00080000:3.0:1784583966.475549:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1784583966.475953:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583966.477939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.478008:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237696 00000100:00100000:2.0:1784583966.478017:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237696 00000100:00100000:2.0:1784583966.478077:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:2.0:1784583966.478086:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+54:12457:x1871271580237696:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583966.478120:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.478139:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0200/0xdab2421a42e487ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5c0 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.478185:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0200/0xdab2421a42e487ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c0 expref: 55 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.478198:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0200/0xdab2421a42e487ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c0 expref: 55 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.478213:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:2.0:1784583966.478216:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784583966.478219:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0200, rc 0) 00000100:00100000:2.0:1784583966.478267:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:12457:x1871271580237696:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 182us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.478274:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:1.0:1784583966.481806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.481891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580237952 00000100:00100000:2.0:1784583966.481901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580237952 00000100:00100000:2.0:1784583966.481957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:2.0:1784583966.481966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+55:12457:x1871271580237952:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583966.482224:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:12457:x1871271580237952:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 257us (425us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1784583966.482232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1784583966.576138:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.576240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580238080 00000100:00100000:0.0:1784583966.576249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580238080 00000100:00100000:0.0:1784583966.576315:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:0.0:1784583966.576324:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:12467:x1871271580238080:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:0.0:1784583966.576756:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576776:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576787:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576798:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576806:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576813:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576889:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576897:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.576973:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784583966.577027:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577040:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577056:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577074:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577080:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583966.577084:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577092:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577105:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583966.577107:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583966.577111:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577117:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e487f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577130:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577135:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577141:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577145:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583966.577154:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577160:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577168:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:0.0:1784583966.577171:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583966.577174:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577178:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e487fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577187:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577193:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577199:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577204:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583966.577206:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577212:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577219:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.577221:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583966.577230:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.577236:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.577308:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:12467:x1871271580238080:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 984us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.577317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:1.0:1784583966.623580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.623838:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580238336 00000100:00100000:2.0:1784583966.623849:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580238336 00000100:00100000:2.0:1784583966.623910:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 221 00000100:00100000:2.0:1784583966.623921:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+56:12470:x1871271580238336:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583966.623954:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.623976:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48808 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5c7 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624048:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624073:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624085:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624096:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624104:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624111:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624211:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4881d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624220:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4881d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624228:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4881d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583966.624236:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784583966.624320:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624328:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624335:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624341:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.624345:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624352:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624364:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583966.624367:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.624371:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624378:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4880f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624392:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624398:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624403:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624422:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.624432:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624438:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624447:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:2.0:1784583966.624450:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.624453:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.624459:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.625091:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c7 expref: 59 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.625107:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4881d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c7 expref: 58 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.625113:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:2.0:1784583966.625116:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583966.625118:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1600, rc 0) 00000100:00100000:2.0:1784583966.625185:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:12470:x1871271580238336:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1266us (1622us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1784583966.625192:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 221 00000100:00100000:2.0:1784583966.635666:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.635801:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580238464 00000100:00100000:0.0:1784583966.635811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580238464 00000100:00100000:0.0:1784583966.635872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 222 00000100:00100000:0.0:1784583966.635881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:12470:x1871271580238464:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1784583966.635947:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.635963:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.635974:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636007:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636012:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636018:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636023:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583966.636040:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636047:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636069:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.636072:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583966.636076:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.636083:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4882b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.636160:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:12470:x1871271580238464:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 279us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.636167:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 222 00000100:00100000:1.0:1784583966.642573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.642817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580238720 00000100:00100000:2.0:1784583966.642826:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580238720 00000100:00100000:2.0:1784583966.642881:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1784583966.642907:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+58:12470:x1871271580238720:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1784583966.643148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:12470:x1871271580238720:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 242us (590us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1784583966.643156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1784583966.746948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.747150:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580238976 00000100:00100000:0.0:1784583966.747160:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580238976 00000100:00100000:0.0:1784583966.747223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:0.0:1784583966.747232:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+59:12480:x1871271580238976:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583966.747257:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583966.747260:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784583966.747286:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e487ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ab expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747304:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583966.747309:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583966.747323:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48832 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747647:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747662:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747673:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583966.747683:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784583966.747776:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e48832 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ce expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747791:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ce expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.747800:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.747803:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784583966.747806:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9c00, rc 0) 00000100:00100000:0.0:1784583966.747872:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:12480:x1871271580238976:12345-192.168.203.51@tcp:101:bash.0 Request processed in 640us (934us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1784583966.747879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:1.0:1784583966.752078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.752120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.752192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580239104 00000100:00100000:0.0:1784583966.752201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580239104 00000100:00100000:0.0:1784583966.752261:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:0.0:1784583966.752270:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:12480:x1871271580239104:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784583966.752296:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583966.752330:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48847 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752368:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752382:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752777:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752888:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752905:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.752914:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.752917:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784583966.752920:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9600, rc 0) 00000100:00100000:0.0:1784583966.752971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:12480:x1871271580239104:12345-192.168.203.51@tcp:101:bash.0 Request processed in 702us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.752978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:3.0:1784583966.753038:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580239232 00000100:00100000:3.0:1784583966.753043:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580239232 00000100:00100000:3.0:1784583966.753094:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:3.0:1784583966.753102:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+61:2401:x1871271580239232:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583966.753112:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583966.753133:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e48839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ce expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.753144:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583966.753147:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583966.753172:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:2401:x1871271580239232:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 72us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.753179:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1784583966.755883:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583966.755966:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580239488 00000100:00100000:3.0:1784583966.755975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580239488 00000100:00100000:3.0:1784583966.756036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 225 00000100:00100000:3.0:1784583966.756046:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+60:12480:x1871271580239488:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1784583966.756110:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583966.756206:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4881d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c7 expref: 60 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.756226:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583966.756231:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784583966.756420:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.756433:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.756442:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784583966.756517:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1784583966.756542:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000129bfccf reply state 00000000172451b3 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.756567:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.756574:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583966.756577:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784583966.756580:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784583966.756664:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:12480:x1871271580239488:12345-192.168.203.51@tcp:36:bash.0 Request processed in 618us (789us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1784583966.756671:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 225 00000020:00080000:3.0:1784583966.756676:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784583966.761026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.761346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580239616 00000100:00100000:2.0:1784583966.761356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580239616 00000100:00100000:2.0:1784583966.761432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:2.0:1784583966.761443:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+62:12480:x1871271580239616:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784583966.761464:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.761830:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4885c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.761919:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.761934:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.761946:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583966.761975:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784583966.761979:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583966.761996:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.762021:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e4885c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.762068:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.762078:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:2.0:1784583966.762081:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583966.762084:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0e00, rc 0) 00000100:00100000:2.0:1784583966.762185:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:12480:x1871271580239616:12345-192.168.203.51@tcp:101:bash.0 Request processed in 743us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.762193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:1.0:1784583966.769039:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.769142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580239872 00000100:00100000:2.0:1784583966.769151:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580239872 00000100:00100000:2.0:1784583966.769243:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1784583966.769255:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+63:12480:x1871271580239872:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1784583966.769762:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+64:12480:x1871271580239872:12345-192.168.203.51@tcp:35:bash.0 Request processed in 509us (733us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784583966.769772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:1.0:1784583966.813502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.813542:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.813724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240000 00000100:00100000:2.0:1784583966.813734:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240000 00000100:00100000:2.0:1784583966.813793:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 385 00000100:00100000:2.0:1784583966.813804:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580240000:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583966.813875:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580240000:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 73us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.813883:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 385 00000100:00100000:3.0:1784583966.814044:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240256 00000100:00100000:3.0:1784583966.814049:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240256 00000100:00100000:3.0:1784583966.814099:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:3.0:1784583966.814107:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580240256:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583966.814140:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580240256:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.814146:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:1.0:1784583966.814270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.814303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.814332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.814527:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240512 00000100:00100000:0.0:1784583966.814532:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240512 00000100:00100000:0.0:1784583966.814578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240128 00000100:00100000:0.0:1784583966.814581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240128 00000100:00100000:0.0:1784583966.814595:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240384 00000100:00100000:0.0:1784583966.814597:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240384 00000100:00100000:0.0:1784583966.814611:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 321 00000100:00100000:0.0:1784583966.814624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580240512:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583966.814656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580240512:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.814662:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 321 00000100:00100000:0.0:1784583966.814674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 322 00000100:00100000:0.0:1784583966.814679:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580240128:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583966.814703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580240128:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.814710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 322 00000100:00100000:0.0:1784583966.814721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 323 00000100:00100000:0.0:1784583966.814727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580240384:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583966.814751:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580240384:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.814757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 323 00000100:00080000:1.0:1784583966.815372:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583966.815377:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583966.831099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.831201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240640 00000100:00100000:0.0:1784583966.831211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240640 00000100:00100000:0.0:1784583966.831273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 227 00000100:00100000:0.0:1784583966.831285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+64:12486:x1871271580240640:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583966.831308:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583966.831328:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4886a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5e3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831389:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831786:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831799:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583966.831841:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784583966.831845:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583966.831862:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831885:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e4886a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5e3 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831904:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5e3 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.831913:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583966.831916:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583966.831919:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9400, rc 0) 00000100:00100000:0.0:1784583966.831974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580240640:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 691us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.831981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 227 00000100:00100000:1.0:1784583966.837360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.837453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580240768 00000100:00100000:2.0:1784583966.837511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580240768 00000100:00100000:2.0:1784583966.837576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 228 00000100:00100000:2.0:1784583966.837587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580240768:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583966.837606:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.837626:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837688:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837702:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837714:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837725:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837732:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837738:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837805:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837814:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837822:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583966.837867:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784583966.837871:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583966.837889:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837910:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837915:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837921:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837926:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.837931:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837937:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837948:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:2.0:1784583966.837951:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.837955:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837962:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e4887f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837985:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837991:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.837997:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838002:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784583966.838005:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838011:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838020:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:2.0:1784583966.838022:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784583966.838026:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838032:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e48886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838066:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e48878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838080:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.838098:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:2.0:1784583966.838100:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784583966.838103:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1600, rc 0) 00000100:00100000:2.0:1784583966.838156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12486:x1871271580240768:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 571us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.838163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 228 00000100:00100000:1.0:1784583966.841671:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.841779:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241024 00000100:00100000:2.0:1784583966.841788:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241024 00000100:00100000:2.0:1784583966.841845:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 229 00000100:00100000:2.0:1784583966.841855:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12486:x1871271580241024:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784583966.841874:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583966.841893:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48894 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5f1 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842003:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842018:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842027:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842035:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842103:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842123:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583966.842137:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304803100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599157376:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784583966.842244:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.842253:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 67 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583966.842262:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304802680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599157504:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583966.842285:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407480840 going to sleep for 11 seconds 00000100:00100000:1.0:1784583966.846255:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583966.846397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1784583966.846854:0:9809:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.51@tcp) returned -22 from blocking AST (req@0000000055d95698 x1871271599157376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.846877:0:9809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.846902:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e4888d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ea expref: 67 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583966.846932:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304803100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599157376:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583966.846947:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304802680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599157504:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583966.846970:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583966.846975:0:9809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.846984:0:9809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583966.846993:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.848024:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241152 00000100:00100000:0.0:1784583966.848036:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241152 00000100:00100000:0.0:1784583966.848137:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241280 00000100:00100000:0.0:1784583966.848141:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241280 00010000:00010000:0.0:1784583966.848158:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 68 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583966.848199:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1784583966.848209:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:2399:x1871271580241280:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583966.848223:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583966.848230:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 68 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848240:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 68 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848257:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48863 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5dc expref: 68 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848272:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.848276:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848285:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848292:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.848316:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583966.848364:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:2399:x1871271580241280:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 156us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.848371:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1784583966.848390:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:1.0:1784583966.848666:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583966.848674:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583966.848692:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784583966.848814:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1c00/0xdab2421a42e48894 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 68 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583966.848832:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 67 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583966.848839:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:1.0:1784583966.848842:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784583966.848844:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0a00, rc 0) 00000100:00100000:1.0:1784583966.848875:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12486:x1871271580241024:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 7022us (7213us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784583966.848882:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 229 00000100:00100000:0.0:1784583966.851426:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:2401:x1871271580241152:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583966.851492:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583966.851498:0:6500:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dab2421a42e4888d) 00010000:00010000:0.0:1784583966.851500:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583966.851651:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:2401:x1871271580241152:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 3157us (5314us total) trans 0 rc 116/116 00000100:00100000:0.0:1784583966.851662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:1.0:1784583966.854022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.854112:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241536 00000100:00100000:2.0:1784583966.854121:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241536 00000100:00100000:2.0:1784583966.854183:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784583966.854193:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12486:x1871271580241536:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:2.0:1784583966.854206:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583966.854231:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0200/0xdab2421a42e487ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5c0 expref: 66 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.854250:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:2.0:1784583966.854256:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583966.854310:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580241536:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.854331:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1784583966.857049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583966.857132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241664 00000100:00100000:2.0:1784583966.857142:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241664 00000100:00100000:2.0:1784583966.857197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 230 00000100:00100000:2.0:1784583966.857207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a038850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580241664:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:2.0:1784583966.857314:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.857331:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583966.857342:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784583966.857449:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784583966.857719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a038850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580241664:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 510us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.857727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 230 00000100:00100000:1.0:1784583966.861843:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583966.861921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241792 00000100:00100000:0.0:1784583966.861930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241792 00000100:00100000:0.0:1784583966.862010:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 231 00000100:00100000:0.0:1784583966.862020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+65:12486:x1871271580241792:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784583966.862040:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583966.862068:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5f8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862121:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862132:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862150:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862161:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862172:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583966.862188:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583966.862193:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583966.862201:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8200, rc 0) 00000100:00100000:0.0:1784583966.862294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12486:x1871271580241792:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 274us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.862302:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 231 00000100:00100000:2.0:1784583966.893681:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599157632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583966.893747:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583966.893817:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599157632 00000100:00100000:2.0:1784583966.893823:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599157632 00000100:00100000:2.0:1784583966.893877:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784583966.893885:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599157632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583966.893912:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784583966.893948:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599157632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.893970:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784583966.894011:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599157632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784583966.894182:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583966.894190:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583966.894198:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599157760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583966.894224:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894247:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599157760 00000100:00100000:1.0:1784583966.894251:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599157760 00000100:00100000:1.0:1784583966.894279:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784583966.894284:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599157760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784583966.894294:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583966.894322:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599157760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583966.894329:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784583966.894352:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599157760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784583966.894695:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599158016:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894753:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599158528:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894786:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599159040:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894816:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784583966.894820:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599158144:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894888:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599158656:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894915:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599159168:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.894930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894950:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599157888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583966.894972:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.894986:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599158400:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.895020:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599158912:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.895053:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784583966.895068:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599158272:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.895102:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599158784:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.895127:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599159296:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.895162:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599157888 00000100:00100000:1.0:1784583966.895166:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599157888 00000100:00100000:1.0:1784583966.895194:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784583966.895200:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599157888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784583966.895213:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784583966.895240:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599157888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583966.895246:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784583966.895261:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158528 00000100:00100000:1.0:1784583966.895264:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158528 00000100:00100000:1.0:1784583966.895278:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158272 00000100:00100000:1.0:1784583966.895279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158272 00000100:00100000:1.0:1784583966.895290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784583966.895295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599158528:12345-0@lo:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583966.895331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784583966.895340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784583966.895350:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599158272:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583966.895378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1784583966.895389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583966.895412:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599158528:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895428:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599158272:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.895441:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599157888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583966.895457:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158912 00000100:00100000:1.0:1784583966.895460:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158912 00000100:00100000:1.0:1784583966.895500:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599159296 00000100:00100000:1.0:1784583966.895503:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599159296 00000100:00100000:1.0:1784583966.895520:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784583966.895526:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599158912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583966.895826:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784583966.895834:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599159296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583966.895866:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599159296:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583966.895872:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784583966.896764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599159040 00000100:00100000:2.0:1784583966.896773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599159040 00000100:00100000:2.0:1784583966.896808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158144 00000100:00100000:2.0:1784583966.896812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158144 00000100:00100000:2.0:1784583966.896824:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158656 00000100:00100000:2.0:1784583966.896827:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158656 00000100:00100000:2.0:1784583966.896842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599159168 00000100:00100000:2.0:1784583966.896845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599159168 00000100:00100000:2.0:1784583966.896858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158400 00000100:00100000:2.0:1784583966.896860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158400 00000100:00100000:2.0:1784583966.896871:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158784 00000100:00100000:2.0:1784583966.896874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158784 00000100:00100000:2.0:1784583966.896890:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1784583966.896898:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599159040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.896964:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599159040:12345-0@lo:400:kworker.0 Request processed in 67us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.896971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1784583966.896985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784583966.896991:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599158144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.897018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599158144:12345-0@lo:400:kworker.0 Request processed in 27us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.897023:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784583966.897033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784583966.897038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599158656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.897075:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599158656:12345-0@lo:400:kworker.0 Request processed in 37us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.897104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784583966.897118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784583966.897124:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599159168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.897154:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599159168:12345-0@lo:400:kworker.0 Request processed in 31us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.897160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784583966.897173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784583966.897178:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599158400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.897203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599158400:12345-0@lo:400:kworker.0 Request processed in 25us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.897209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784583966.897220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784583966.897225:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599158784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.897251:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599158784:12345-0@lo:400:kworker.0 Request processed in 26us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583966.897257:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784583966.897429:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599158144:0@lo:400:kworker.0 00000100:00100000:3.0:1784583966.897442:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599158656:0@lo:400:kworker.0 00010000:00080000:3.0:1784583966.897456:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30499b100 x1871271599159168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583966.897496:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599159168:0@lo:400:kworker.0 00000100:00100000:0.0:1784583966.898358:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599158016 00000100:00100000:0.0:1784583966.898365:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599158016 00000100:00100000:0.0:1784583966.898421:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1784583966.898429:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599158016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583966.898917:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599159040:0@lo:400:kworker.0 00000100:00100000:2.0:1784583966.899066:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583966.899082:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599159424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583966.900641:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599158016:12345-0@lo:400:kworker.0 Request processed in 2204us (5898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.900654:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:0.0:1784583966.900744:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583966.900749:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583966.900753:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784583966.900787:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30499a300 x1871271599158784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583966.900800:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599158784:0@lo:400:kworker.0 00000100:00100000:0.0:1784583966.900814:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599159296:0@lo:400:kworker.0 00000100:00100000:0.0:1784583966.900825:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599158400:0@lo:400:kworker.0 00000100:00100000:3.0:1784583966.900877:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599158016:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.901048:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599158912:12345-0@lo:400:kworker.0 Request processed in 5520us (6006us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583966.901165:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599158912:0@lo:400:kworker.0 00000100:00100000:1.0:1784583966.901213:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784583966.902007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583966.902158:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599159424 00000100:00100000:1.0:1784583966.902166:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599159424 00000100:00100000:1.0:1784583966.902273:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784583966.902282:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43f15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599159424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583966.902305:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583966.902359:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43f15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599159424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583966.902366:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784583966.902657:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599159424:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784583966.964267:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583967.406146:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599159552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583967.406232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583967.407740:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599159552 00000100:00100000:3.0:1784583967.407753:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599159552 00000100:00100000:3.0:1784583967.407815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784583967.407825:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599159552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583967.407861:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784583967.407940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599159552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.407947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784583967.411227:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599159552:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784583967.535032:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583967.535063:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583967.535092:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784583967.535102:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583967.535230:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599159680:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784583967.535348:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff180 going to sleep for 11 seconds 00000100:00100000:1.0:1784583967.539359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.539548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580241920 00000100:00100000:2.0:1784583967.539557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580241920 00000100:00100000:2.0:1784583967.539662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00100000:2.0:1784583967.539673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580241920:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784583967.539700:0:6516:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784583967.539788:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599159680:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784583967.539808:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580241920:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 136us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583967.539816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00080000:3.0:1784583967.540508:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583967.542842:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.543147:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580242048 00000100:00100000:0.0:1784583967.543157:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580242048 00000100:00100000:0.0:1784583967.543214:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:0.0:1784583967.543223:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12487:x1871271580242048:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.543288:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543303:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543314:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543327:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543333:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543339:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543358:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543382:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.543389:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583967.544105:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784583967.544113:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583967.544129:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544144:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544153:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544161:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544167:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.544171:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544178:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544191:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:0.0:1784583967.544195:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.544199:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544218:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e488b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544231:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544237:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544243:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544247:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.544250:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544256:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544263:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583967.544266:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.544269:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544274:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544287:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544293:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544304:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544309:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.544312:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544319:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544326:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.544329:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.544331:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.544337:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.544520:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12487:x1871271580242048:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 1294us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.544530:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:2.0:1784583967.547876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.548105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580242304 00000100:00100000:0.0:1784583967.548115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580242304 00000100:00100000:0.0:1784583967.549301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:0.0:1784583967.549315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+66:12487:x1871271580242304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.549334:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583967.549354:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e488cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee5ff expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549506:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549522:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549533:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583967.549543:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784583967.549622:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549630:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549636:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549642:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.549646:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549653:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549664:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.549667:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784583967.549670:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549686:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549726:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e488cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ff expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549736:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:0.0:1784583967.549739:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784583967.549743:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e488cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5ff expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.549752:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9000, rc 0) 00000100:00100000:0.0:1784583967.549813:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580242304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 503us (1945us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1784583967.549820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:1.0:1784583967.552073:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.552172:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580242432 00000100:00100000:3.0:1784583967.552181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580242432 00000100:00100000:3.0:1784583967.552239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:3.0:1784583967.552250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580242432:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784583967.552296:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784583967.552417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580242432:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 156us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.552425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:1.0:1784583967.556956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.557206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580242688 00000100:00100000:0.0:1784583967.557216:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580242688 00000100:00100000:0.0:1784583967.557275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:0.0:1784583967.557285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580242688:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.557305:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583967.557309:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784583967.557333:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5e3 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.557351:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583967.557356:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583967.557382:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e488e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee606 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784583967.557758:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1784583967.557909:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.557923:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.557933:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.557981:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e488e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee606 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.557996:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee606 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.558003:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583967.558006:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784583967.558008:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8e00, rc 0) 00000100:00100000:0.0:1784583967.558071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:12487:x1871271580242688:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 787us (1123us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784583967.558078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:2.0:1784583967.560753:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.561097:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580242944 00000100:00100000:0.0:1784583967.561106:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580242944 00000100:00100000:0.0:1784583967.561241:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 237 00000100:00100000:0.0:1784583967.561252:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:12487:x1871271580242944:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.561324:0:9809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583967.561348:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e488e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee606 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561366:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1e00) 00010000:00010000:0.0:1784583967.561375:0:9809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784583967.561394:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561407:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561415:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561448:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561455:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561462:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561536:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561542:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561548:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561560:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.561564:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561572:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561582:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583967.561584:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.561588:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561593:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e488f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561603:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561609:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561615:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561631:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.561634:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561640:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561661:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x48e3b612 (ffff98b301fd1200) 00010000:00010000:0.0:1784583967.561664:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.561667:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.561673:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e488fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x48e3b612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.561741:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580242944:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 491us (996us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784583967.561748:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 237 00000100:00100000:1.0:1784583967.563837:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.564484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580243072 00000100:00100000:0.0:1784583967.564494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580243072 00000100:00100000:0.0:1784583967.564565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 238 00000100:00100000:0.0:1784583967.564576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+67:12487:x1871271580243072:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.564596:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583967.564617:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48904 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee60d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564653:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564664:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564675:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564782:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e48904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564808:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.564817:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:0.0:1784583967.564820:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784583967.564824:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:0.0:1784583967.564886:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:12487:x1871271580243072:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 311us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.567083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 238 00000100:00100000:1.0:1784583967.567957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.568310:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580243328 00000100:00100000:0.0:1784583967.568320:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580243328 00000100:00100000:0.0:1784583967.568647:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 239 00000100:00100000:0.0:1784583967.568678:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+68:12487:x1871271580243328:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.568821:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.568838:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.568848:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784583967.569063:0:9809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1784583967.569073:0:9809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410754605185ns, next at 411754602522ns, rc = 0 00000004:00010000:0.0:1784583967.569124:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000541393ee reply state 000000005bc6ff52 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.569155:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.569163:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:0.0:1784583967.569166:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784583967.569169:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784583967.569342:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+70:12487:x1871271580243328:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 684us (1388us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1784583967.569350:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 239 00000100:00100000:3.0:1784583967.571109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.571218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580243456 00000100:00100000:0.0:1784583967.571227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580243456 00000100:00100000:0.0:1784583967.571650:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 240 00000100:00100000:0.0:1784583967.571663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+70:12487:x1871271580243456:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.571692:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583967.571715:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee614 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.571774:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.571789:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.571808:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:0.0:1784583967.571811:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583967.571815:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8a00, rc 0) 00000100:00100000:0.0:1784583967.571874:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+71:12487:x1871271580243456:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 214us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.571905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 240 00000100:00100000:1.0:1784583967.575290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.575335:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580243584 00000100:00100000:0.0:1784583967.575345:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580243584 00000100:00080000:3.0:1784583967.575506:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583967.575573:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:0.0:1784583967.575584:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580243584:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784583967.575800:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2401:x1871271580243584:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 217us (519us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1784583967.575808:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:1.0:1784583967.583325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.583435:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580243840 00000100:00100000:3.0:1784583967.583445:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580243840 00000100:00100000:3.0:1784583967.583544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:3.0:1784583967.583555:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+71:12487:x1871271580243840:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784583967.583809:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+72:12487:x1871271580243840:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 256us (492us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1784583967.583834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:3.0:1784583967.586961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.587148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244096 00000100:00100000:0.0:1784583967.587157:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244096 00000100:00100000:0.0:1784583967.587264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 241 00000100:00100000:0.0:1784583967.587277:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+72:12487:x1871271580244096:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784583967.587412:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+72:12487:x1871271580244096:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 138us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.587420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 241 00000100:00100000:1.0:1784583967.589731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.590667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244224 00000100:00100000:2.0:1784583967.590679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244224 00000100:00100000:2.0:1784583967.590757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 242 00000100:00100000:2.0:1784583967.590768:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+72:12487:x1871271580244224:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784583967.590788:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784583967.590811:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee61b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.590876:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.590891:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.590901:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784583967.590942:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784583967.590962:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.591007:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e48920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee61b expref: 74 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.591027:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee61b expref: 73 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.591035:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:2.0:1784583967.591038:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784583967.591042:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0800, rc 0) 00000100:00100000:2.0:1784583967.591172:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+73:12487:x1871271580244224:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 405us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583967.591180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 242 00000100:00100000:2.0:1784583967.609770:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.610552:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244352 00000100:00100000:3.0:1784583967.610572:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244352 00000100:00100000:3.0:1784583967.610627:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:3.0:1784583967.610637:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+10:2400:x1871271580244352:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583967.610655:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583967.610675:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee622 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784583967.610700:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e971f, blocks: 0x0 00010000:00010000:3.0:1784583967.610720:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1784583967.610724:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583967.610734:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 11 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.610752:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 11 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.610767:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97200, rc 0) 00000100:00100000:3.0:1784583967.610822:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:2400:x1871271580244352:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 187us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.610829:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00000040:00080000:2.0:1784583967.611993:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784583967.615218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.615300:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244608 00000100:00100000:1.0:1784583967.615309:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244608 00000100:00100000:1.0:1784583967.615357:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:1.0:1784583967.615367:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+73:12487:x1871271580244608:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784583967.615509:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+73:12487:x1871271580244608:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.615527:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 243 00000100:00100000:1.0:1784583967.626173:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.626319:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244736 00000100:00100000:3.0:1784583967.626328:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244736 00000100:00100000:3.0:1784583967.626658:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:3.0:1784583967.626672:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:12487:x1871271580244736:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784583967.626691:0:11860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583967.626710:0:11860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee629 expref: -99 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.626743:0:11860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.626753:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583967.626757:0:11860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784583967.626763:0:11860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 12 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.626797:0:11860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.626810:0:11860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583967.626823:0:11860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11860:1871271599159808:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583967.626913:0:11860:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac900 going to sleep for 11 seconds 00000100:00100000:2.0:1784583967.632844:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.632995:0:11860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11860:1871271599159808:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583967.633030:0:11860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 12 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.633082:0:11860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97000, rc 0) 00000100:00100000:3.0:1784583967.633146:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:12487:x1871271580244736:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 6478us (6982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.633155:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:0.0:1784583967.633358:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244864 00000100:00100000:0.0:1784583967.633365:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244864 00010000:00010000:0.0:1784583967.633397:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.633440:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:0.0:1784583967.633449:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2401:x1871271580244864:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583967.633462:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583967.633511:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.633531:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.633551:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94904fb/0xdab2421a42e4892e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee622 expref: 12 pid: 8805 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.633574:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583967.633578:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583967.633586:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 11 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.633597:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 11 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.633630:0:8443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 11 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.633643:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8443:1871271599159936:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583967.633701:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff180 going to sleep for 11 seconds 00000100:00100000:0.0:1784583967.638323:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8443:1871271599159936:192.168.203.51@tcp:105: 00010000:00010000:0.0:1784583967.638348:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583967.638397:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:2401:x1871271580244864:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4949us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.638414:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:2.0:1784583967.639826:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.639891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580244992 00000100:00100000:1.0:1784583967.639898:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580244992 00002000:00100000:1.0:1784583967.639945:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98b304803b80 x1871271580244992/t0(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:293/0 lens 504/0 e 0 to 0 dl 1784583978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784583967.639956:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b304803b80 with x1871271580244992 ext(0->12) 00002000:00010000:1.0:1784583967.639961:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b304803b80 00000100:00100000:1.0:1784583967.639989:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784583967.639998:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+11:2401:x1871271580244992:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784583967.641933:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2401:x1871271580244992:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 1925us (2101us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784583967.641946:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00002000:00100000:1.0:1784583967.641958:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98b304803b80 x1871271580244992/t4294967321(0) o4->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:293/0 lens 504/448 e 0 to 0 dl 1784583978 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784583967.641967:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b304803b80 with x1871271580244992 ext(0->12) 00002000:00010000:1.0:1784583967.641972:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b304803b80 00000100:00100000:1.0:1784583967.657977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.658577:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580245120 00000100:00100000:2.0:1784583967.658592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580245120 00000100:00100000:1.0:1784583967.658781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:1.0:1784583967.658801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+73:12487:x1871271580245120:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784583967.660851:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1784583967.660868:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:1.0:1784583967.660963:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.660975:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663345:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663369:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663374:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663385:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663413:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784583967.663432:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583967.663438:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663445:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96800/0xdab2421a42e4863a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663503:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663510:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663516:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663520:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b44216a600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663523:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663529:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663536:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98b43e8ab100) 00010000:00010000:1.0:1784583967.663539:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583967.663542:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663547:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a600/0xdab2421a42e486e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663565:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663585:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663590:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663595:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663599:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663605:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663613:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:1.0:1784583967.663616:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583967.663619:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663625:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983600/0xdab2421a42e48760 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663639:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663644:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663650:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663654:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663663:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663669:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663677:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b43e8ab200) 00010000:00010000:1.0:1784583967.663680:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583967.663682:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663687:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e48783 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663717:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663723:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663729:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663734:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663737:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663743:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663751:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:1.0:1784583967.663754:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583967.663763:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663769:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96e00/0xdab2421a42e48855 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663784:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663791:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663797:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663803:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583967.663806:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663812:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663820:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583967.663823:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784583967.663826:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.663831:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e48912 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784583967.665116:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784583967.665145:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b4066b43c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784583967.665150:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ebdb500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b41e708900 00000020:00080000:2.0:1784583967.665154:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ebdbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b41805a800 00000004:00080000:2.0:1784583967.665180:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1784583967.665319:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599160064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784583967.665387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583967.665446:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599160064 00000100:00100000:0.0:1784583967.665453:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599160064 00000020:00080000:1.0:1784583967.665514:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784583967.665516:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784583967.665525:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599160064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784583967.665553:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1784583967.665592:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a5e971e, atime: 0x0, ctime: 0x6a5e971e, blocks: 0x8 00010000:00010000:0.0:1784583967.665599:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.665614:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1784583967.665618:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583967.665624:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.665639:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.665649:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.665656:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.665680:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784583967.665820:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1871271599160064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 295us (431us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784583967.665833:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1784583967.665873:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43efa8000/2, rc 0, transno 4294967311 00000100:00100000:0.0:1784583967.665879:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599160064:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784583967.665972:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583967.665988:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.666004:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784583967.666008:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.666016:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.666032:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.666039:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e4893c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.666065:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583967.666067:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583967.666069:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583967.667068:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599160192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784583967.667072:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599160320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784583967.667109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583967.667132:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599160192 00000100:00100000:1.0:1784583967.667137:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599160192 00000100:00100000:1.0:1784583967.667182:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784583967.667190:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599160192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784583967.667211:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1784583967.667229:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.667259:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.667267:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784583967.667271:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784583967.667275:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.667306:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.667319:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 12 pid: 8426 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.667331:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599160448:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784583967.667491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583967.667519:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599160320 00000100:00100000:3.0:1784583967.667522:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599160320 00000100:00100000:3.0:1784583967.667548:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784583967.667554:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1871271599160320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784583967.667649:0:11860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784583967.667653:0:11860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784583968 00002000:00010000:3.0:1784583967.667655:0:11860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784583967.667657:0:11860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784583967 -> 1784583968 00002000:00010000:3.0:1784583967.667660:0:11860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784583967.667705:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3640:x1871271599160320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (213us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784583967.667712:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784583967.667844:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f3c0 going to sleep for 11 seconds 00000004:00080000:0.0:1784583967.667930:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b3048a4000/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784583967.667936:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599160320:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1784583967.669787:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b43eab10c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784583967.669797:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea47900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b43eab16c0 00000020:00080000:2.0:1784583967.669801:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43ea47e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b30244dc00 00000020:00080000:1.0:1784583967.670222:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784583967.670294:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1784583967.670422:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12487:x1871271580245120:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 11625us (12450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.670432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 244 00000100:00100000:3.0:1784583967.671884:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599160448:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784583967.671921:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.672075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.672145:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580245248 00000100:00100000:2.0:1784583967.672152:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580245248 00010000:00010000:2.0:1784583967.672185:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 13 pid: 8426 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583967.672227:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:2.0:1784583967.672235:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+13:2400:x1871271580245248:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784583967.672249:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583967.672255:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 13 pid: 8426 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.672267:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 13 pid: 8426 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.672291:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070400ce1/0xdab2421a42e486f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee581 expref: 13 pid: 8426 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.672305:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583967.672309:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784583967.672314:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.672323:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.672381:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583967.672433:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2400:x1871271580245248:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 197us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583967.672441:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00010000:00010000:0.0:1784583967.672857:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.672866:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.672876:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.672884:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.672913:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784583967.673081:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3639:x1871271599160192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5890us (5970us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1784583967.673088:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1784583967.673127:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b3048a4700/2, rc 0, transno 4294967323 00000100:00100000:0.0:1784583967.673141:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599160192:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784583967.673584:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583967.673593:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.673602:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfc00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784583967.673606:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.673615:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.673629:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.673636:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007beee92b/0xdab2421a42e48943 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.673654:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583967.673656:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583967.673658:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583967.678182:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.678261:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580245376 00000100:00100000:0.0:1784583967.678272:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580245376 00000100:00100000:0.0:1784583967.678332:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:0.0:1784583967.678341:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+12:2398:x1871271580245376:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784583967.680919:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1784583967.680947:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1784583967.681174:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2398:x1871271580245376:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 2828us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.681187:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:2.0:1784583967.689015:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.689173:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580245632 00000100:00100000:1.0:1784583967.689182:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580245632 00000100:00100000:1.0:1784583967.689245:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:1.0:1784583967.689255:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12487:x1871271580245632:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784583967.689354:0:9809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583967.689417:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0800/0xdab2421a42e48927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee61b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.689438:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583967.689443:0:9809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784583967.689523:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.689538:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.689547:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784583967.689687:0:9809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bf62e4c reply state 00000000e81c70d5 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.689699:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.689706:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583967.689708:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784583967.689711:0:9809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784583967.690314:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12487:x1871271580245632:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 557us (818us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1784583967.690328:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 245 00000100:00100000:2.0:1784583967.693845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.693973:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580245760 00000100:00100000:3.0:1784583967.693982:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580245760 00000100:00100000:3.0:1784583967.694040:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:3.0:1784583967.694058:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580245760:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784583967.694232:0:11860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1784583967.694236:0:11860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1784583968 -> 1784583967 00002000:00010000:3.0:1784583967.694238:0:11860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784583966 00002000:00010000:3.0:1784583967.694240:0:11860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784583968 -> 1784583967 00002000:00010000:3.0:1784583967.694242:0:11860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1784583967.694307:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580245760:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 257us (469us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1784583967.694315:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:3.0:1784583967.697426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.697821:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246016 00000100:00100000:2.0:1784583967.697830:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246016 00000100:00100000:2.0:1784583967.697889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:2.0:1784583967.697900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:12487:x1871271580246016:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784583967.697966:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.697982:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.697993:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.698028:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.698041:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583967.698066:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599160576:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784583967.698153:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407480480 going to sleep for 11 seconds 00000100:00100000:3.0:1784583967.702375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.702519:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246144 00000100:00100000:1.0:1784583967.702529:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246144 00010000:00010000:1.0:1784583967.702585:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.702635:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:1.0:1784583967.702644:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:2401:x1871271580246144:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583967.702660:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583967.702668:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.702682:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.702705:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583967.702712:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.702722:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.702730:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.702749:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583967.702808:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+23:2401:x1871271580246144:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 165us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.702984:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 100 00010000:00010000:0.0:1784583967.704984:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4890b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee60d expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.705011:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1871271599160576:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583967.705036:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705047:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705063:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705105:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705113:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705120:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705147:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.705151:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705159:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705173:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:0.0:1784583967.705176:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784583967.705180:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.705185:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e48951 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.705313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12487:x1871271580246016:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 7415us (7894us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784583967.705322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 246 00000100:00100000:3.0:1784583967.708741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.708895:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246272 00000100:00100000:0.0:1784583967.708906:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246272 00000100:00100000:0.0:1784583967.709001:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:0.0:1784583967.709012:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2398:x1871271580246272:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.709068:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.709089:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 8 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.709114:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583967.709119:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784583967.709125:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.709162:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 8 pid: 11860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.709176:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 8 pid: 11860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.709191:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599160704:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583967.709272:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1784583967.712881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.713038:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1871271599160704:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583967.713077:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.713154:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246400 00000100:00100000:1.0:1784583967.713162:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246400 00010000:00010000:1.0:1784583967.713200:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 9 pid: 11860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.713264:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:1.0:1784583967.713273:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+9:2401:x1871271580246400:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583967.713288:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583967.713309:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 9 pid: 11860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.713321:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 9 pid: 11860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.713342:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e92315/0xdab2421a42e48935 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee629 expref: 9 pid: 11860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.713358:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784583967.713362:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784583967.713369:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.713378:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.713421:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583967.713511:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2401:x1871271580246400:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 239us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.713519:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 101 00010000:00010000:0.0:1784583967.713684:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713694:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713713:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713727:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713735:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713742:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784583967.713746:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713754:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713766:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.713774:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48958 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.713827:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2398:x1871271580246272:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 4817us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.713835:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:3.0:1784583967.716777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.716987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246656 00000100:00100000:0.0:1784583967.716997:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246656 00000100:00100000:0.0:1784583967.717066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 247 00000100:00100000:0.0:1784583967.717094:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:12487:x1871271580246656:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784583967.717181:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.717198:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.717208:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.717243:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.717256:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 21 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.717272:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599160832:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583967.717351:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1784583967.720708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.720794:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599160832:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583967.720826:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583967.720973:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246784 00000100:00100000:3.0:1784583967.720981:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246784 00010000:00010000:3.0:1784583967.721016:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583967.721062:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 102 00000100:00100000:3.0:1784583967.721071:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2401:x1871271580246784:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583967.721085:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583967.721091:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721102:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721140:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e4884e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5d5 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721154:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583967.721159:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721168:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721174:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721180:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.721206:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583967.721258:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:2401:x1871271580246784:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 188us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.721265:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 102 00010000:00010000:0.0:1784583967.721315:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721322:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721557:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721574:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721582:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721610:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.721621:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 21 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.721634:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599160960:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784583967.721683:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784583967.726454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583967.726726:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599160960:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784583967.726752:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.726835:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580246912 00000100:00100000:1.0:1784583967.726844:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580246912 00010000:00010000:1.0:1784583967.726883:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.726918:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:1.0:1784583967.726928:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2401:x1871271580246912:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583967.726942:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583967.726950:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.726962:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.726984:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e48919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee614 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.726999:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583967.727004:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.727015:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.727023:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.727058:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583967.727115:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:2401:x1871271580246912:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 188us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.727134:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 103 00010000:00010000:0.0:1784583967.727241:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.727248:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784583967.727359:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1784583967.727530:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1784583967.727583:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1784583967.727662:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599161088:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784583967.727721:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583967.727751:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b408913540 going to sleep for 11 seconds 00000100:00100000:1.0:1784583967.728206:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599161088 00000100:00100000:1.0:1784583967.728213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599161088 00000100:00100000:1.0:1784583967.728259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784583967.728267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599161088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784583967.728339:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599161088:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.728347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1784583967.731595:0:6515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1784583967.731645:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1784583967.731689:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b3048a4000, transno 4294967322 00000004:00080000:0.0:1784583967.731701:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b3048a4700, transno 4294967323 00000100:00100000:0.0:1784583967.731710:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599161088:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1784583967.732188:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1784583967.732263:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599161216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784583967.732321:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583967.732358:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a545300 going to sleep for 11 seconds 00000100:00100000:1.0:1784583967.732420:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599161216 00000100:00100000:1.0:1784583967.732427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599161216 00000100:00100000:1.0:1784583967.732492:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784583967.732501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871271599161216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784583967.732633:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1871271599161216:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (311us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784583967.732641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784583967.733038:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6515:1871271599161216:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784583967.733089:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733100:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733108:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733115:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.733119:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733127:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733142:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:0.0:1784583967.733158:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583967.733163:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733169:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e48966 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733193:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733199:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733205:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733210:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.733213:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733219:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733228:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.733230:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784583967.733236:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733248:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733257:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.733294:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.733305:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599161344:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784583967.733355:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a545300 going to sleep for 11 seconds 00000100:00100000:2.0:1784583967.746663:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.746907:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580247040 00000100:00100000:1.0:1784583967.746916:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580247040 00000100:00100000:1.0:1784583967.746972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:1.0:1784583967.746981:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12486:x1871271580247040:12345-192.168.203.51@tcp:49:lfs.0 00000100:00100000:1.0:1784583967.747122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12486:x1871271580247040:12345-192.168.203.51@tcp:49:lfs.0 Request processed in 141us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583967.747130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:0.0:1784583967.751256:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1871271599161344:192.168.203.51@tcp:105: 00010000:00010000:0.0:1784583967.751286:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751295:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0c00/0xdab2421a42e488a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751331:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751344:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751366:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751377:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751383:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751388:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751419:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.751424:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751431:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751444:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.751447:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.751450:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751456:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4896d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751497:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751505:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751511:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751515:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.751518:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751524:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751559:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.751562:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784583967.751565:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.751571:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e4895f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583967.751736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12487:x1871271580246656:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 34643us (34966us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1784583967.751745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 247 00000020:00080000:0.0:1784583967.751751:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784583967.752272:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784583967.752278:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784583967.753330:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784583967.753342:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784583967.756198:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.756286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580247296 00000100:00100000:1.0:1784583967.756296:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580247296 00000100:00100000:1.0:1784583967.756550:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 248 00000100:00100000:1.0:1784583967.756571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12486:x1871271580247296:12345-192.168.203.51@tcp:58:lfs.0 00000040:00080000:1.0:1784583967.756751:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1784583967.756836:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+24:12486:x1871271580247296:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 268us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.758896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583967.759039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580247552 00000100:00100000:2.0:1784583967.759059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580247552 00000100:00100000:2.0:1784583967.759116:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:2.0:1784583967.759126:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+25:12487:x1871271580247552:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784583967.759374:0:6517:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784583967.759420:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1784583967.759454:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759499:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759512:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759521:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759528:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759547:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.759579:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784583967.759656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12487:x1871271580247552:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 531us (767us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1784583967.759678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000020:00080000:2.0:1784583967.759683:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784583967.764040:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583967.764063:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.764075:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784583967.764080:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.764090:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.764110:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:2.0:1784583967.764113:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784583967.764118:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.764125:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0e00/0xdab2421a42e48974 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583967.764146:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583967.764148:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583967.764150:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583967.764768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 248 00000100:00100000:2.0:1784583967.794263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.794368:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580247680 00000100:00100000:1.0:1784583967.794378:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580247680 00000100:00100000:1.0:1784583967.794450:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 249 00000100:00100000:1.0:1784583967.794460:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+26:12489:x1871271580247680:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784583967.794525:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583967.794913:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4897b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee630 expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.794976:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.794990:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795002:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795017:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795023:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795029:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795130:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795143:0:9809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 27 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795153:0:9809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795187:0:9809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 27 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583967.795202:0:9809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 27 pid: 9809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583967.795217:0:9809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599161472:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784583967.795430:0:9809:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f240 going to sleep for 11 seconds 00000100:00100000:1.0:1784583967.799179:0:9809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9809:1871271599161472:192.168.203.51@tcp:104: 00010000:00010000:1.0:1784583967.799206:0:9809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784583967.800898:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583967.801158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580247936 00000100:00100000:1.0:1784583967.801167:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580247936 00000100:00100000:1.0:1784583967.801217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:1.0:1784583967.801227:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:6167:x1871271580247936:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784583967.801652:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:6167:x1871271580247936:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 424us (761us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1784583967.801678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1784583967.804125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583967.804210:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580248064 00000100:00100000:3.0:1784583967.804219:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580248064 00010000:00010000:3.0:1784583967.804256:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 29 pid: 9809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583967.804298:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:3.0:1784583967.804308:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:2401:x1871271580248064:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784583967.804337:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784583967.804344:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 29 pid: 9809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804368:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 29 pid: 9809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804391:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e4889b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f1 expref: 29 pid: 9809 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804426:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583967.804431:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804441:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804448:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583967.804522:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784583967.804584:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:2401:x1871271580248064:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 276us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583967.804591:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 104 00010000:00010000:0.0:1784583967.804891:0:9809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.804900:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583967.804949:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784583967.804953:0:9809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583967.804971:0:9809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.804985:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.804993:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805001:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805019:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805025:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cee00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.805030:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805037:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805046:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:0.0:1784583967.805060:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.805065:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805071:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cee00/0xdab2421a42e48982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805083:0:9809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805090:0:9809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805096:0:9809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805101:0:9809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784583967.805104:0:9809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805119:0:9809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805128:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98b30397a700) 00010000:00010000:0.0:1784583967.805130:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784583967.805132:0:9809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805138:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce600/0xdab2421a42e48989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805172:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4897b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee630 expref: 28 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805186:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee630 expref: 27 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583967.805193:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583967.805195:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784583967.805197:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce400, rc 0) 00000100:00100000:0.0:1784583967.805240:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12489:x1871271580247680:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 10781us (10986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583967.805247:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 249 00010000:00010000:2.0:1784583967.983666:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784583968.608811:0:14752:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583968.608821:0:14752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784583968.608853:0:14752:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784583968.608860:0:14752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784583968.816134:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583968.816143:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583968.816166:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784583968.816174:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784583968.816297:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599161600:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784583968.816401:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784583968.835758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583968.835790:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580248192 00000100:00100000:2.0:1784583968.835803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580248192 00000100:00100000:2.0:1784583968.835859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 250 00000100:00100000:2.0:1784583968.835870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12501:x1871271580248192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784583968.835903:0:6514:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784583968.836018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12501:x1871271580248192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 149us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583968.836026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 250 00000100:00100000:1.0:1784583968.836075:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1871271599161600:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784583968.839704:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583968.843692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580248448 00000100:00100000:1.0:1784583968.843705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580248448 00000100:00100000:1.0:1784583968.843764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 251 00000100:00100000:1.0:1784583968.843777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+27:12501:x1871271580248448:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784583968.843798:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784583968.843829:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf400/0xdab2421a42e48997 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee637 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583968.843932:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4899e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583968.843946:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4899e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583968.843959:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4899e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784583968.843972:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784583968.844083:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cf400/0xdab2421a42e48997 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee637 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583968.844098:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4899e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee637 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583968.844113:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:1.0:1784583968.844116:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784583968.844119:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce200, rc 0) 00000100:00100000:1.0:1784583968.844180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12501:x1871271580248448:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 406us (4484us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1784583968.844189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 251 00000100:00100000:3.0:1784583968.859037:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583968.862062:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580248576 00000100:00100000:0.0:1784583968.862077:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580248576 00000100:00100000:0.0:1784583968.862144:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:0.0:1784583968.862153:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:2400:x1871271580248576:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583968.862168:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583968.862191:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce200/0xdab2421a42e4899e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee637 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583968.862207:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:0.0:1784583968.862212:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583968.862272:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:2400:x1871271580248576:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 120us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583968.862280:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1784583968.866735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583968.867210:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580248832 00000100:00100000:3.0:1784583968.867220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580248832 00000100:00100000:3.0:1784583968.867278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 252 00000100:00100000:3.0:1784583968.867287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+28:12501:x1871271580248832:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784583968.867368:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.867384:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.867394:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868206:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868218:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868225:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868231:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784583968.868236:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868244:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868256:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583968.868259:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784583968.868263:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583968.868269:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583968.870145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12501:x1871271580248832:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 2852us (3412us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1784583968.870157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 252 00000100:00100000:0.0:1784583968.875463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583968.875529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249088 00000100:00100000:0.0:1784583968.875538:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249088 00000100:00100000:0.0:1784583968.877038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1784583968.877065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+29:12501:x1871271580249088:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784583968.877446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12501:x1871271580249088:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 385us (1990us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784583968.877454:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000040:00080000:0.0:1784583968.882025:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583968.882033:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583968.887938:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784583968.887958:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784583969.010116:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583970.031316:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583970.477918:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583970.477940:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599161728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784583970.478014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583970.478574:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599161728 00000100:00100000:1.0:1784583970.478582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599161728 00000100:00100000:1.0:1784583970.478630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784583970.478640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599161728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784583970.478674:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784583970.478726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599161728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583970.478733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784583970.478777:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599161728:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784583970.555277:0:14804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784583970.555288:0:14804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784583970.555324:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784583970.555330:0:14804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784583970.755115:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583970.757917:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249344 00000100:00100000:3.0:1784583970.757931:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249344 00000100:00100000:3.0:1784583970.758003:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:3.0:1784583970.758013:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+30:12521:x1871271580249344:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784583970.758047:0:9809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784583970.758068:0:9809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e489b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee63e expref: -99 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583970.758171:0:9809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583970.758185:0:9809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583970.758198:0:9809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784583970.758209:0:9809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784583970.758306:0:9809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b97000/0xdab2421a42e489b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee63e expref: 33 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583970.758322:0:9809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee63e expref: 32 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583970.758344:0:9809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583970.758346:0:9809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784583970.758350:0:9809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784583970.758424:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:12521:x1871271580249344:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 412us (3317us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784583970.758432:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00080000:2.0:1784583970.761109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583970.773198:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583970.773356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249472 00000100:00100000:1.0:1784583970.773365:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249472 00000100:00100000:1.0:1784583970.773454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:1.0:1784583970.773496:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:12521:x1871271580249472:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:1.0:1784583970.773587:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773616:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773653:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773660:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773667:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773674:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfa00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583970.773678:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773686:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773697:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:1.0:1784583970.773700:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784583970.773705:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583970.773711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfa00/0xdab2421a42e489c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784583970.773789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:12521:x1871271580249472:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 326us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583970.773797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:1.0:1784583970.855790:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583970.855909:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249600 00000100:00100000:0.0:1784583970.855919:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249600 00000100:00100000:0.0:1784583970.855996:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:0.0:1784583970.856006:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580249600:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1784583970.856024:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583970.856053:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e489cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee645 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784583970.856080:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a5e971f, atime: 0x6a5e971e, ctime: 0x6a5e971f, blocks: 0x8 00010000:00010000:0.0:1784583970.856110:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1784583970.856115:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784583970.856125:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e489cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee645 expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583970.856144:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e489cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee645 expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583970.856159:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8e00, rc 0) 00000100:00100000:0.0:1784583970.856223:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580249600:12345-192.168.203.51@tcp:101:cat.0 Request processed in 219us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583970.856230:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00080000:2.0:1784583970.856707:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583970.866123:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583970.866281:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249728 00000100:00100000:3.0:1784583970.866291:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249728 00002000:00100000:3.0:1784583970.866340:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98b43efaad80 x1871271580249728/t0(0) o3->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:296/0 lens 488/0 e 0 to 0 dl 1784583981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784583970.866350:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b43efaad80 with x1871271580249728 ext(0->4095) 00002000:00010000:3.0:1784583970.866356:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b43efaad80 00000100:00100000:3.0:1784583970.866399:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784583970.866408:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2398:x1871271580249728:12345-192.168.203.51@tcp:3:cat.0 00000100:00100000:3.0:1784583970.866648:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2398:x1871271580249728:12345-192.168.203.51@tcp:3:cat.0 Request processed in 240us (533us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784583970.866655:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00002000:00100000:3.0:1784583970.866661:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98b43efaad80 x1871271580249728/t0(0) o3->bfe5cd00-263a-47c1-b0c6-0ab6049cb709@192.168.203.51@tcp:296/0 lens 488/4536 e 0 to 0 dl 1784583981 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784583970.866668:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98b43efaad80 with x1871271580249728 ext(0->4095) 00002000:00010000:3.0:1784583970.866671:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98b43efaad80 00010000:00010000:2.0:1784583971.054595:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583971.926092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583971.926174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583971.926325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250112 00000100:00100000:3.0:1784583971.926334:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250112 00000100:00100000:3.0:1784583971.926412:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 330 00000100:00100000:3.0:1784583971.926431:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580250112:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583971.926528:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2400:x1871271580250112:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583971.926536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 330 00000100:00080000:1.0:1784583971.926648:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583971.927725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249856 00000100:00100000:0.0:1784583971.927735:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249856 00000100:00100000:0.0:1784583971.927776:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 387 00000100:00100000:0.0:1784583971.927784:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580249856:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583971.927854:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580249856:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583971.927862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 387 00000100:00100000:2.0:1784583971.931268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583971.931316:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583971.931341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583971.931366:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583971.932064:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583971.932095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250624 00000100:00100000:2.0:1784583971.932104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250624 00000100:00100000:2.0:1784583971.932161:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580249984 00000100:00100000:2.0:1784583971.932164:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580249984 00000100:00100000:2.0:1784583971.932177:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250496 00000100:00100000:2.0:1784583971.932179:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250496 00000100:00100000:2.0:1784583971.932195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 331 00000100:00100000:2.0:1784583971.932204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580250624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583971.932268:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250368 00000100:00100000:2.0:1784583971.932275:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580250624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583971.932275:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250368 00000100:00100000:2.0:1784583971.932297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 331 00000100:00100000:2.0:1784583971.932321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 332 00000100:00100000:1.0:1784583971.932321:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250240 00000100:00100000:1.0:1784583971.932326:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250240 00000100:00100000:2.0:1784583971.932346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:2400:x1871271580249984:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583971.932352:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:1.0:1784583971.932362:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580250368:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583971.932393:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2400:x1871271580250368:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583971.932399:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:1.0:1784583971.932411:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:1.0:1784583971.932416:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580250240:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583971.932436:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+8:2400:x1871271580250240:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 20us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583971.932442:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:3.0:1784583971.932486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 333 00000100:00100000:3.0:1784583971.932497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580250496:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:1.0:1784583971.932505:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583971.932511:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583971.932514:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784583971.932529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2400:x1871271580250496:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583971.932536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 333 00000100:00100000:2.0:1784583971.934034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+32:2400:x1871271580249984:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 1686us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583971.934048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 332 00000100:00100000:2.0:1784583972.013781:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599161856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583972.013861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.013942:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599161856 00000100:00100000:2.0:1784583972.013950:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599161856 00000100:00100000:2.0:1784583972.014000:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784583972.014010:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599161856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583972.014049:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784583972.014092:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599161856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.014100:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1784583972.014118:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784583972.014150:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599161856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583972.014746:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784583972.015053:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583972.015066:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599162112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583972.015105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.015147:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599162240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583972.015170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.015198:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162112 00000100:00100000:2.0:1784583972.015213:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162112 00000100:00100000:2.0:1784583972.015246:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162240 00000100:00100000:2.0:1784583972.015249:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162240 00000100:00100000:2.0:1784583972.015265:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784583972.015271:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599162112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784583972.015291:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583972.015324:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599162112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.015331:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784583972.015342:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784583972.015348:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599162240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583972.015356:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784583972.015379:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599162240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.015384:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1784583972.015399:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784583972.015402:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583972.015424:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599162240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583972.015447:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599162112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583972.015692:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599161984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583972.015718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.015878:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599162624:0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.015907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.017865:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599163136:0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.017912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.017947:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784583972.017954:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599162496:0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.017978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1784583972.017986:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1784583972.017994:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599163008:0@lo:400:kworker.0 00000001:00080000:0.0:1784583972.017997:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1784583972.018011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.018054:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162624 00000100:00100000:3.0:1784583972.018060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162624 00000100:00100000:3.0:1784583972.018102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784583972.018110:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417218c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599162624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.018168:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417218c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599162624:12345-0@lo:400:kworker.0 Request processed in 58us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583972.018176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784583972.020019:0:10350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599161984 00000100:00100000:2.0:1784583972.020041:0:10350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599161984 00000100:00100000:2.0:1784583972.020102:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784583972.020111:0:10350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599161984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583972.020134:0:10350:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1784583972.020196:0:10350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599161984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (4476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.020216:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1784583972.020257:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583972.020272:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599162752:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.020308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.020331:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599163264:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.020351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.020367:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784583972.020373:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599162368:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.020398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.020426:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599162880:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.020447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583972.020461:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599163392:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.020494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.020766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162880 00000100:00100000:3.0:1784583972.020771:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162880 00000100:00100000:3.0:1784583972.020794:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784583972.020800:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599162880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.021268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163136 00000100:00100000:2.0:1784583972.021272:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163136 00000100:00100000:2.0:1784583972.021308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162496 00000100:00100000:2.0:1784583972.021311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162496 00000100:00100000:2.0:1784583972.021323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163008 00000100:00100000:2.0:1784583972.021326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163008 00000100:00100000:2.0:1784583972.021337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162752 00000100:00100000:2.0:1784583972.021340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162752 00000100:00100000:2.0:1784583972.021350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163264 00000100:00100000:2.0:1784583972.021353:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163264 00000100:00100000:2.0:1784583972.021364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163392 00000100:00100000:2.0:1784583972.021366:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163392 00000100:00100000:2.0:1784583972.021379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1784583972.021385:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599163136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.021429:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599163136:12345-0@lo:400:kworker.0 Request processed in 44us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.021436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1784583972.021448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784583972.021454:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599162496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.021578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599162496:12345-0@lo:400:kworker.0 Request processed in 54us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.021586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784583972.021599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784583972.021605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599163008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.021634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599163008:12345-0@lo:400:kworker.0 Request processed in 30us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.021640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784583972.021650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784583972.021655:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599162752:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784583972.021726:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583972.021731:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583972.022670:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599162368 00000100:00100000:1.0:1784583972.022679:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599162368 00000100:00100000:1.0:1784583972.022721:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1784583972.022729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599162368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.022831:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599162880:12345-0@lo:400:kworker.0 Request processed in 2029us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583972.022840:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784583972.022866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784583972.022874:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599163264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.023713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599162752:12345-0@lo:400:kworker.0 Request processed in 2053us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.023724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784583972.023748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784583972.023757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599163392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.023797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599163392:12345-0@lo:400:kworker.0 Request processed in 43us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583972.023862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784583972.024079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599162368:12345-0@lo:400:kworker.0 Request processed in 1350us (3678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583972.024086:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1784583972.024642:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599162496:0@lo:400:kworker.0 00000100:00100000:0.0:1784583972.024657:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599163008:0@lo:400:kworker.0 00000100:00100000:0.0:1784583972.024668:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599162624:0@lo:400:kworker.0 00010000:00080000:0.0:1784583972.024682:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303960e00 x1871271599163136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583972.024692:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599163136:0@lo:400:kworker.0 00000100:00100000:0.0:1784583972.024712:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599161984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583972.025664:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599162368:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.025691:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599162880:0@lo:400:kworker.0 00010000:00080000:2.0:1784583972.025703:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303961180 x1871271599163392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583972.025711:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599163392:0@lo:400:kworker.0 00000100:00100000:2.0:1784583972.025720:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599162752:0@lo:400:kworker.0 00000100:00100000:3.0:1784583972.026543:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599163264:12345-0@lo:400:kworker.0 Request processed in 3666us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583972.026555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1784583972.026686:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599163264:0@lo:400:kworker.0 00010000:00010000:3.0:1784583972.077946:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583972.526693:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784583972.526726:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599163520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583972.526803:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583972.527149:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163520 00000100:00100000:3.0:1784583972.527158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163520 00000100:00100000:3.0:1784583972.527209:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1784583972.527219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599163520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583972.527251:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784583972.527300:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599163520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583972.527307:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784583972.527642:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599163520:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784583973.103299:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784583973.568110:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1784583973.568123:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1784583973.576274:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1784583973.576310:0:6493:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b40a545780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1784583973.576316:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b4052f1200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b40a545600 00000020:00080000:2.0:1784583973.576319:0:6493:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b4052f1a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b30270e000 00000020:00080000:2.0:1784583973.576336:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1784583973.576435:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576448:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576457:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576464:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfe00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784583973.576496:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576504:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576522:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98b301fd1a00) 00010000:00010000:1.0:1784583973.576524:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784583973.576529:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583973.576535:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172cfe00/0xdab2421a42e4894a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9809 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784583973.576567:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784583973.576639:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1784583974.125717:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583975.149677:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583975.603227:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599163648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583975.603304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583975.603792:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163648 00000100:00100000:3.0:1784583975.603800:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163648 00000100:00100000:3.0:1784583975.603851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784583975.603861:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599163648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583975.603894:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583975.603951:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599163648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583975.603958:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784583975.604057:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599163648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583975.695832:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583975.695863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250752 00000100:00100000:2.0:1784583975.695872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250752 00000100:00100000:2.0:1784583975.695931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00100000:2.0:1784583975.695941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12166:x1871271580250752:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784583975.696046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12166:x1871271580250752:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583975.696054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00080000:2.0:1784583975.696076:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583975.705194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583975.705230:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580250880 00000100:00100000:2.0:1784583975.705248:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580250880 00000100:00100000:2.0:1784583975.705308:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00100000:2.0:1784583975.705317:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:12166:x1871271580250880:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784583975.705408:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:12166:x1871271580250880:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583975.705429:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00080000:2.0:1784583975.705451:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784583975.710818:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583975.710858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251136 00000100:00100000:0.0:1784583975.710867:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251136 00000100:00100000:0.0:1784583975.710916:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:0.0:1784583975.710925:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:12166:x1871271580251136:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784583975.711141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:12166:x1871271580251136:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 217us (332us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1784583975.711149:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784583975.925094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583975.925270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251264 00000100:00100000:0.0:1784583975.925280:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251264 00000100:00100000:0.0:1784583975.925358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 257 00000100:00100000:0.0:1784583975.925368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:12978:x1871271580251264:12345-192.168.203.51@tcp:101:lsof.0 00010000:00010000:0.0:1784583975.925386:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784583975.925405:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e489d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee64c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925515:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925528:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925542:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784583975.925587:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784583975.925590:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784583975.925611:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925649:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9000/0xdab2421a42e489d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee64c expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925667:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee64c expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583975.925676:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:0.0:1784583975.925679:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784583975.925682:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:0.0:1784583975.925731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:12978:x1871271580251264:12345-192.168.203.51@tcp:101:lsof.0 Request processed in 365us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583975.925738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 257 00000100:00080000:2.0:1784583975.925795:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784583976.173780:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583977.046552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583977.046604:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583977.046618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251392 00000100:00100000:3.0:1784583977.046629:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251392 00000100:00100000:0.0:1784583977.046637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583977.046676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583977.046685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 389 00000100:00100000:3.0:1784583977.046697:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580251392:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583977.046703:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583977.046912:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251904 00000100:00100000:1.0:1784583977.046917:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251904 00000100:00100000:1.0:1784583977.046958:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:2.0:1784583977.046964:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251648 00000100:00100000:1.0:1784583977.046966:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580251904:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583977.046968:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251648 00000100:00100000:2.0:1784583977.047032:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252160 00000100:00100000:2.0:1784583977.047036:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252160 00000100:00100000:2.0:1784583977.047051:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251520 00000100:00100000:2.0:1784583977.047053:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251520 00000100:00100000:2.0:1784583977.047066:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 340 00000100:00100000:2.0:1784583977.047072:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580251648:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583977.047540:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0d05096-428d-430e-97a4-2faca82157e3+13:2401:x1871271580251392:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 844us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.047549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 389 00000100:00100000:3.0:1784583977.047585:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 341 00000100:00100000:3.0:1784583977.047592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580252160:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583977.047615:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2401:x1871271580252160:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.047621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 341 00000100:00100000:3.0:1784583977.047634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 342 00000100:00100000:3.0:1784583977.047639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:2401:x1871271580251520:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784583977.047659:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:2401:x1871271580251520:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 21us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.047677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 342 00000100:00080000:3.0:1784583977.047704:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784583977.047708:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784583977.047711:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583977.049676:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580251904:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 2691us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583977.049692:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:0.0:1784583977.049708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583977.049976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583977.050096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252032 00000100:00100000:0.0:1784583977.050103:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252032 00000100:00100000:0.0:1784583977.050158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 343 00000100:00100000:0.0:1784583977.050169:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2401:x1871271580252032:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583977.050224:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2401:x1871271580252032:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583977.050232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 343 00000100:00080000:0.0:1784583977.050262:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784583977.053307:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2401:x1871271580251648:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 6223us (6692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.053324:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 340 00000100:00100000:1.0:1784583977.056252:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580251776 00000100:00100000:1.0:1784583977.056267:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580251776 00000100:00100000:1.0:1784583977.056369:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:1.0:1784583977.056380:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580251776:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583977.056487:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2401:x1871271580251776:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 108us (6782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583977.056494:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00080000:0.0:1784583977.056774:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784583977.069663:0:13782:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784583977.069673:0:13782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784583977.069758:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1784583977.069766:0:13782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784583977.133756:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599163776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784583977.133838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.133903:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599164288:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.133929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.133947:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599164800:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.133970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134020:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599165312:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134040:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134055:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784583977.134061:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599163904:0@lo:400:kworker.0 00000100:00100000:1.0:1784583977.134064:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599164160:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583977.134089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134110:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599164416:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134145:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599164928:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134181:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599165440:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134257:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599164032:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134297:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599164544:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134342:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599165056:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134377:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599165568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784583977.134395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784583977.134416:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599165696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583977.134434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.134459:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163776 00000100:00100000:2.0:1784583977.134492:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163776 00000100:00100000:2.0:1784583977.134534:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165568 00000100:00100000:2.0:1784583977.134543:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165568 00000100:00100000:2.0:1784583977.134563:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165696 00000100:00100000:2.0:1784583977.134566:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165696 00000100:00100000:2.0:1784583977.134581:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784583977.134588:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599163776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784583977.134616:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583977.134654:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599163776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.134662:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784583977.134677:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784583977.134682:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599165568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784583977.134696:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784583977.134724:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599165568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.134730:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784583977.134741:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784583977.134747:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599165696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784583977.134761:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784583977.134784:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599165696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.134789:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784583977.134806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599163904 00000100:00100000:2.0:1784583977.134809:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599163904 00000100:00100000:2.0:1784583977.134829:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784583977.134835:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599163904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134862:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3641:x1871271599163904:12345-0@lo:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.134875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784583977.134903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164160 00000100:00100000:2.0:1784583977.134907:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164160 00000100:00100000:2.0:1784583977.134922:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164416 00000100:00100000:2.0:1784583977.134925:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164416 00000100:00100000:2.0:1784583977.134936:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784583977.134942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599164160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.134973:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599164160:12345-0@lo:400:kworker.0 Request processed in 30us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.134979:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784583977.135002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784583977.135009:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599164416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583977.135031:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599164672:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135034:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599164416:12345-0@lo:400:kworker.0 Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135040:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784583977.135057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.135064:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164800 00000100:00100000:2.0:1784583977.135067:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164800 00000100:00100000:1.0:1784583977.135070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599165184:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135084:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165312 00000100:00100000:2.0:1784583977.135087:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165312 00000100:00100000:1.0:1784583977.135089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583977.135096:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164928 00000100:00100000:2.0:1784583977.135099:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164928 00000100:00100000:2.0:1784583977.135107:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165440 00000100:00100000:2.0:1784583977.135109:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165440 00000100:00100000:2.0:1784583977.135122:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784583977.135128:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599164800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135157:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599164800:12345-0@lo:400:kworker.0 Request processed in 29us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135162:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784583977.135180:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583977.135186:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599165312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135211:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599165312:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135217:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784583977.135226:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784583977.135232:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599164928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135234:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784583977.135242:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599165440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135254:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599164928:12345-0@lo:400:kworker.0 Request processed in 23us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135260:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784583977.135284:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599165440:12345-0@lo:400:kworker.0 Request processed in 43us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.135289:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784583977.135293:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599165696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583977.135302:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1784583977.135307:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1784583977.135311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164288 00000100:00100000:3.0:1784583977.135314:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164288 00000100:00100000:2.0:1784583977.135326:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599165568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784583977.135329:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164032 00000100:00100000:3.0:1784583977.135331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164032 00000100:00100000:2.0:1784583977.135351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599163904:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164544 00000100:00100000:2.0:1784583977.135362:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599164416:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164544 00000100:00100000:2.0:1784583977.135369:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599164928:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165056 00000100:00100000:2.0:1784583977.135376:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:3.0:1784583977.135379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165056 00000004:00080000:2.0:1784583977.135380:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:3.0:1784583977.135388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599164672 00000100:00100000:3.0:1784583977.135390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599164672 00000004:00080000:2.0:1784583977.135394:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43efa8000, transno 4294967311 00000100:00100000:3.0:1784583977.135401:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165184 00000100:00100000:2.0:1784583977.135402:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599165440:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165184 00000100:00100000:2.0:1784583977.135412:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599164800:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1784583977.135420:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599164288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135421:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599165312:0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135441:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599163776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784583977.135448:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599164288:12345-0@lo:400:kworker.0 Request processed in 29us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.135453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1784583977.135481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784583977.135486:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599164288:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135487:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599164032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135507:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784583977.135514:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599164544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135530:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599164032:12345-0@lo:400:kworker.0 Request processed in 43us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.135536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784583977.135539:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599164544:12345-0@lo:400:kworker.0 Request processed in 27us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135544:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784583977.135548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784583977.135553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599165056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135555:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784583977.135560:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599164672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135583:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599164672:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.135584:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599165056:12345-0@lo:400:kworker.0 Request processed in 32us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583977.135589:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784583977.135591:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784583977.135599:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784583977.135604:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599165184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583977.135627:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599165184:12345-0@lo:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.135774:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599164032:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135783:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599164544:0@lo:400:kworker.0 00000100:00100000:3.0:1784583977.135805:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599165056:0@lo:400:kworker.0 00000100:00100000:1.0:1784583977.136231:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599164160:0@lo:400:kworker.0 00010000:00080000:1.0:1784583977.136249:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b30499aa00 x1871271599164672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583977.136259:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599164672:0@lo:400:kworker.0 00010000:00080000:1.0:1784583977.136279:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eadea00 x1871271599165184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583977.136287:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599165184:0@lo:400:kworker.0 00000100:00100000:1.0:1784583977.137506:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784583977.137522:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599165824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784583977.137611:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583977.137617:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784583977.137620:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583977.137623:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583977.137644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583977.139289:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165824 00000100:00100000:0.0:1784583977.139301:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165824 00000100:00100000:0.0:1784583977.139375:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784583977.139386:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599165824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784583977.139409:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784583977.139461:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784583977.139483:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599165824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583977.139490:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784583977.139678:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599165824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784583977.197942:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583977.646327:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599165952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784583977.646399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583977.646738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599165952 00000100:00100000:3.0:1784583977.646746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599165952 00000100:00100000:3.0:1784583977.646795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784583977.646804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599165952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784583977.646837:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784583977.646889:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599165952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583977.646896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784583977.646977:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599165952:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1784583977.838208:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784583978.227072:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784583979.011932:0:15002:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:46:17 (1784583977) 00010000:00010000:1.0:1784583979.248748:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784583979.697064:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1784583979.697078:0:6493:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1784583979.697217:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1784583979.697227:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1784583980.278174:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583980.721779:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599166080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784583980.721849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583980.728163:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166080 00000100:00100000:2.0:1784583980.728176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166080 00000100:00100000:2.0:1784583980.728238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1784583980.728247:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599166080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784583980.728285:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784583980.728363:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599166080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (6513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583980.728381:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1784583980.728438:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599166080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784583981.300197:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583982.164426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583982.164514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583982.164530:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252288 00000100:00100000:1.0:1784583982.164541:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252288 00000100:00100000:1.0:1784583982.164609:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 391 00000100:00100000:1.0:1784583982.164625:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580252288:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784583982.164701:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0d05096-428d-430e-97a4-2faca82157e3+13:2399:x1871271580252288:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.164709:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 391 00000100:00100000:2.0:1784583982.164905:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252416 00000100:00100000:2.0:1784583982.164910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252416 00000100:00100000:2.0:1784583982.164980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 350 00000100:00100000:2.0:1784583982.164987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2399:x1871271580252416:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784583982.165034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:2399:x1871271580252416:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 48us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.165041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 350 00000100:00080000:0.0:1784583982.165112:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784583982.168752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583982.168815:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583982.169029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252928 00000100:00100000:0.0:1784583982.169038:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252928 00000100:00100000:0.0:1784583982.169126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 351 00000100:00100000:0.0:1784583982.169137:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2398:x1871271580252928:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583982.169212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2398:x1871271580252928:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 78us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.169221:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 351 00000100:00100000:0.0:1784583982.169264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583982.169296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252544 00000100:00100000:0.0:1784583982.169301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252544 00000100:00100000:0.0:1784583982.169331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 352 00000100:00100000:0.0:1784583982.169338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580252544:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583982.169378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580252544:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.169384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 352 00000100:00100000:0.0:1784583982.169435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583982.169753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583982.169777:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252672 00000100:00100000:0.0:1784583982.169781:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252672 00000100:00100000:0.0:1784583982.169808:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580252800 00000100:00100000:0.0:1784583982.169811:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580252800 00000100:00100000:0.0:1784583982.169828:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1784583982.169835:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2398:x1871271580252672:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583982.169868:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2398:x1871271580252672:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.169875:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1784583982.169887:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784583982.169892:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580252800:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583982.169913:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2398:x1871271580252800:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 21us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.169918:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784583982.170021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580253056 00000100:00100000:0.0:1784583982.170024:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580253056 00000100:00100000:0.0:1784583982.170048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 353 00000100:00100000:0.0:1784583982.170062:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580253056:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784583982.170092:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2398:x1871271580253056:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.170097:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 353 00000100:00080000:1.0:1784583982.170300:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784583982.170306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784583982.170309:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784583982.170310:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784583982.255027:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599166336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583982.255032:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599166464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583982.255215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583982.255247:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166336 00000100:00100000:3.0:1784583982.255256:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166336 00000100:00100000:1.0:1784583982.255303:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599166208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784583982.255332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583982.255333:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784583982.255346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599166336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784583982.255391:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784583982.255656:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166208 00000100:00100000:0.0:1784583982.255661:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166208 00000100:00100000:0.0:1784583982.255688:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784583982.255695:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599166208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784583982.255706:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784583982.256068:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599166208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 371us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.256078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1784583982.256113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784583982.256125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583982.256156:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166464 00000100:00100000:0.0:1784583982.256160:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166464 00000100:00100000:0.0:1784583982.256183:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784583982.256189:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599166464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784583982.256205:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784583982.256247:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599166464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.256254:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784583982.256266:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599166208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784583982.256272:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784583982.256855:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599166592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583982.257820:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599166336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2473us (2601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583982.257832:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784583982.257887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583982.257893:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599166336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784583982.257938:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166592 00000100:00100000:2.0:1784583982.257945:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166592 00000100:00100000:3.0:1784583982.258076:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599167104:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.258101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784583982.258114:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599166592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784583982.258115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784583982.258134:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583982.258148:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599167616:0@lo:400:kworker.0 00000100:00100000:3.0:1784583982.258178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.258188:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599166592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.258196:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784583982.258222:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599166592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784583982.258234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167104 00000100:00100000:2.0:1784583982.258239:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167104 00000100:00100000:3.0:1784583982.258240:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784583982.258247:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599166720:0@lo:400:kworker.0 00000100:00100000:3.0:1784583982.258283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.258290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167616 00000100:00100000:1.0:1784583982.258291:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599166848:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.258295:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167616 00000100:00100000:3.0:1784583982.258314:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599167232:0@lo:400:kworker.0 00000100:00100000:1.0:1784583982.258331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583982.258352:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599167360:0@lo:400:kworker.0 00000100:00100000:3.0:1784583982.258355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583982.258378:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599167744:0@lo:400:kworker.0 00000100:00100000:3.0:1784583982.258398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583982.258418:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166720 00000100:00100000:3.0:1784583982.258422:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166720 00000100:00100000:3.0:1784583982.258450:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1784583982.258456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784583982.258465:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599166720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.258500:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599167104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583982.258574:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599166464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583982.258591:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599166976:0@lo:400:kworker.0 00000100:00100000:1.0:1784583982.259703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.259792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599167104:12345-0@lo:400:kworker.0 Request processed in 1324us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.259802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784583982.259822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166848 00000100:00100000:2.0:1784583982.259827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166848 00000100:00100000:2.0:1784583982.259846:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167744 00000100:00100000:2.0:1784583982.259849:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167744 00000100:00100000:2.0:1784583982.259862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167360 00000100:00100000:2.0:1784583982.259869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167360 00000100:00100000:2.0:1784583982.259884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784583982.259891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599167616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784583982.259900:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583982.259927:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599167616:12345-0@lo:400:kworker.0 Request processed in 37us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.259932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784583982.259943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784583982.259948:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599166848:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784583982.259968:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784583982.259972:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784583982.259996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1784583982.260006:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599167744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583982.260043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599167744:12345-0@lo:400:kworker.0 Request processed in 40us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.260050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1784583982.260067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784583982.260078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599166848:12345-0@lo:400:kworker.0 Request processed in 126us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.260089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784583982.260113:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599167360:12345-0@lo:400:kworker.0 Request processed in 39us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.260121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784583982.260128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167232 00000100:00100000:2.0:1784583982.260133:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167232 00010000:00080000:1.0:1784583982.260175:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303961180 x1871271599167744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583982.260204:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599167744:0@lo:400:kworker.0 00000100:00100000:1.0:1784583982.260220:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599167104:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260226:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784583982.260234:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599167616:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599167232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260289:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599167232:12345-0@lo:400:kworker.0 Request processed in 54us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.260300:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599166848:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260306:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784583982.260314:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599167360:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.260344:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599167232:0@lo:400:kworker.0 00000100:00100000:3.0:1784583982.260517:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3639:x1871271599166720:12345-0@lo:400:kworker.0 Request processed in 2052us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583982.260525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1784583982.260742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.260763:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599166720:0@lo:400:kworker.0 00000100:00100000:0.0:1784583982.260861:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599167488:0@lo:400:kworker.0 00000100:00100000:0.0:1784583982.260891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.260976:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167488 00000100:00100000:1.0:1784583982.261014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599166976 00000100:00100000:1.0:1784583982.261019:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599166976 00000100:00100000:1.0:1784583982.261056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784583982.261063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599166976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583982.261106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599166976:12345-0@lo:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.261112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784583982.261233:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599166976:0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.261267:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167488 00000100:00080000:1.0:1784583982.261319:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784583982.261347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784583982.261356:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599167488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583982.261400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599167488:12345-0@lo:400:kworker.0 Request processed in 45us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.261406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00080000:1.0:1784583982.261436:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303963800 x1871271599167488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784583998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583982.261524:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599167488:0@lo:400:kworker.0 00010000:00010000:3.0:1784583982.318770:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583982.520315:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.520464:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580253312 00000100:00100000:2.0:1784583982.520501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580253312 00000100:00100000:2.0:1784583982.520555:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:2.0:1784583982.520565:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+18:13203:x1871271580253312:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1784583982.520823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:13203:x1871271580253312:12345-192.168.203.51@tcp:35:umount.0 Request processed in 257us (527us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1784583982.520831:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:3.0:1784583982.523205:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.524441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580253568 00000100:00100000:2.0:1784583982.524454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580253568 00000100:00100000:2.0:1784583982.524545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:2.0:1784583982.524555:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+19:13203:x1871271580253568:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1784583982.524856:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:13203:x1871271580253568:12345-192.168.203.51@tcp:35:umount.0 Request processed in 302us (1658us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1784583982.524865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1784583982.531004:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.531510:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580253824 00000100:00100000:2.0:1784583982.531520:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580253824 00000100:00100000:2.0:1784583982.531584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:2.0:1784583982.531595:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41728d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+20:13203:x1871271580253824:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1784583982.531865:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41728d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:13203:x1871271580253824:12345-192.168.203.51@tcp:35:umount.0 Request processed in 271us (870us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784583982.531873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:3.0:1784583982.535835:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.535938:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254080 00000100:00100000:2.0:1784583982.535948:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254080 00000100:00100000:2.0:1784583982.536026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:2.0:1784583982.536039:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:13203:x1871271580254080:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1784583982.536770:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:13203:x1871271580254080:12345-192.168.203.51@tcp:35:umount.0 Request processed in 730us (943us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1784583982.536779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:3.0:1784583982.540891:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583982.540934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583982.540976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583982.541131:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254208 00000100:00100000:0.0:1784583982.541141:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254208 00000100:00100000:0.0:1784583982.541195:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254464 00000100:00100000:0.0:1784583982.541199:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254464 00000100:00100000:0.0:1784583982.541212:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254336 00000100:00100000:0.0:1784583982.541214:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254336 00000100:00100000:0.0:1784583982.541229:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:0.0:1784583982.541239:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+15:2400:x1871271580254208:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583982.541253:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583982.541281:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a000/0xdab2421a42e479b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee19f expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583982.541299:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583982.541361:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+14:2400:x1871271580254208:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 123us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.541369:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:0.0:1784583982.541385:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784583982.541392:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+13:2400:x1871271580254464:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583982.541399:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583982.541408:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e47c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee278 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583982.541417:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583982.541452:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+12:2400:x1871271580254464:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.541458:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784583982.541516:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:0.0:1784583982.541523:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+11:2400:x1871271580254336:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784583982.541531:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784583982.541540:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e478f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee160 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583982.541548:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784583982.541564:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+10:2400:x1871271580254336:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 41us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583982.541570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784583982.542950:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583982.543045:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254592 00000100:00100000:1.0:1784583982.543053:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254592 00000100:00100000:1.0:1784583982.543099:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:1.0:1784583982.543107:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2397:x1871271580254592:12345-192.168.203.51@tcp:9:umount.0 00000020:00000080:1.0:1784583982.543136:0:8805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47cd2 00000100:00080000:1.0:1784583982.543144:0:8805:0:(import.c:65:import_set_state_nolock()) ffff98b3041fa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784583982.543208:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1784583982.543737:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+2:2397:x1871271580254592:12345-192.168.203.51@tcp:9:umount.0 Request processed in 628us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583982.543746:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00010000:00010000:2.0:1784583982.543873:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583982.552875:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583982.552934:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580254976 00000100:00100000:3.0:1784583982.552945:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580254976 00000100:00100000:3.0:1784583982.553047:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1784583982.553058:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+7:2397:x1871271580254976:12345-192.168.203.51@tcp:9:umount.0 00000020:00000080:3.0:1784583982.553087:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47f41 00000020:00010000:3.0:1784583982.553095:0:8429:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b437662000: total 0 00000100:00080000:3.0:1784583982.553099:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98b437661000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784583982.553146:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b437662000: total 0 00000001:00000004:3.0:1784583982.553149:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:1.0:1784583982.553199:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b437662000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784583982.553252:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e489cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee645 expref: 5 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583982.553285:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7eb1c6/0xdab2421a42e48300 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee462 expref: 4 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583982.553300:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b437662000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784583982.553313:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583982.553315:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583982.553317:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583982.553327:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+2:2397:x1871271580254976:12345-192.168.203.51@tcp:9:umount.0 Request processed in 270us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583982.553336:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1784583982.575889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.576077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256000 00000100:00100000:2.0:1784583982.576087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256000 00000100:00100000:2.0:1784583982.576204:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 258 00000100:00100000:2.0:1784583982.576216:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+22:2397:x1871271580256000:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:2.0:1784583982.576248:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47905 00000020:00010000:2.0:1784583982.576269:0:6516:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b303a90000: total 0 00000100:00080000:2.0:1784583982.576274:0:6516:0:(import.c:65:import_set_state_nolock()) ffff98b303a93800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583982.576903:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1784583982.577007:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b303a90000: total 0 00010000:00010000:3.0:1784583982.577011:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583982.577061:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b303a90000, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1784583982.577084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+21:2397:x1871271580256000:12345-192.168.203.51@tcp:39:umount.0 Request processed in 870us (1202us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1784583982.577093:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 258 00010000:00010000:3.0:1784583982.577108:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:3.0:1784583982.577111:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583982.577117:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e48369 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee47e expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577136:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583982.577139:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784583982.577143:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96400/0xdab2421a42e489ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee63e expref: 19 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577155:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583982.577157:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784583982.577161:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96200/0xdab2421a42e47ca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee2a2 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577174:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583982.577176:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583982.577180:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96c00/0xdab2421a42e48672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee55e expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577192:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583982.577194:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784583982.577198:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216b800/0xdab2421a42e482eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee45b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577209:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98b301fd1000) 00010000:00010000:3.0:1784583982.577211:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784583982.577214:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e47fa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee37b expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.577244:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b301fd1c00) 00010000:00010000:3.0:1784583982.577246:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784583982.578754:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e47c4d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee28d expref: 14 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.578805:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583982.578808:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583982.578816:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216a400/0xdab2421a42e482c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee44d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.578828:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583982.578831:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583982.578835:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e488b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee5f8 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.578862:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98b43e8a9b00) 00010000:00010000:3.0:1784583982.578865:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784583982.578870:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e48385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee485 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.579081:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98b4092c0200) 00010000:00010000:3.0:1784583982.579085:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784583982.579089:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4172ce400/0xdab2421a42e48990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee630 expref: 10 pid: 9809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.579106:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98b4092c0000) 00010000:00010000:3.0:1784583982.579108:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784583982.579127:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b44216aa00/0xdab2421a42e481e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee415 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.579144:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784583982.579147:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583982.579151:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b403b96000/0xdab2421a42e47c31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee286 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583982.579165:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b303a90000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1784583982.579199:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583982.579201:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583982.579203:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583982.585708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784583982.585803:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256128 00000100:00100000:2.0:1784583982.585813:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256128 00000100:00100000:2.0:1784583982.585934:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 259 00000100:00100000:2.0:1784583982.585946:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+5:2397:x1871271580256128:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:2.0:1784583982.585988:0:9809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4790c 00000100:00080000:2.0:1784583982.586004:0:9809:0:(import.c:65:import_set_state_nolock()) ffff98b303a96800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583982.586035:0:9809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784583982.586699:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfe5cd00-263a-47c1-b0c6-0ab6049cb709+3:2397:x1871271580256128:12345-192.168.203.51@tcp:39:umount.0 Request processed in 753us (1125us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784583982.586710:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 259 00010000:00010000:1.0:1784583982.587727:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583982.766039:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784583982.766064:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599167872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784583982.766136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583982.766675:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599167872 00000100:00100000:2.0:1784583982.766683:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599167872 00000100:00100000:2.0:1784583982.766741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784583982.766750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599167872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784583982.766785:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784583982.766841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599167872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583982.766848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784583982.766978:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599167872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784583983.341737:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583984.302506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583984.302539:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583984.302571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583984.302613:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256384 00000100:00100000:1.0:1784583984.302624:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256384 00000100:00100000:1.0:1784583984.302689:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256640 00000100:00100000:1.0:1784583984.302692:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256640 00000100:00100000:1.0:1784583984.302703:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256512 00000100:00100000:1.0:1784583984.302705:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256512 00000100:00100000:1.0:1784583984.302719:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784583984.302728:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+12:2401:x1871271580256384:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583984.302742:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583984.302760:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b400/0xdab2421a42e47a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1b4 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583984.302794:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583984.302839:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+11:2401:x1871271580256384:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583984.302847:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784583984.302862:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1784583984.302867:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+10:2401:x1871271580256640:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583984.302876:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583984.302883:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e47c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee271 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583984.302892:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583984.302919:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+9:2401:x1871271580256640:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 52us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583984.302925:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1784583984.302935:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1784583984.302941:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+8:2401:x1871271580256512:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784583984.302959:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583984.302967:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96a00/0xdab2421a42e47a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1e5 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583984.302976:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583984.305883:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d05096-428d-430e-97a4-2faca82157e3+7:2401:x1871271580256512:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2929us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583984.305898:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:0.0:1784583984.313724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784583984.313777:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256768 00000100:00100000:1.0:1784583984.313799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256768 00000100:00100000:1.0:1784583984.313869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 260 00000100:00100000:1.0:1784583984.313881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+6:2397:x1871271580256768:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:1.0:1784583984.313921:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47a1d 00000020:00010000:1.0:1784583984.313928:0:6514:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b43eb02000: total 0 00000100:00080000:1.0:1784583984.313932:0:6514:0:(import.c:65:import_set_state_nolock()) ffff98b43eb04000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784583984.313967:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1784583984.314135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2397:x1871271580256768:12345-192.168.203.51@tcp:39:umount.0 Request processed in 255us (418us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1784583984.314142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 260 00000100:00080000:0.0:1784583984.314322:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1784583984.314543:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b43eb02000: total 0 00010000:00010000:3.0:1784583984.314595:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b43eb02000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784583984.314630:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b301fd1900) 00010000:00010000:3.0:1784583984.314634:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784583984.314641:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9800/0xdab2421a42e489dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee64c expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583984.314661:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b43eb02000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784583984.314673:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583984.314675:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583984.314677:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583984.332244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784583984.332354:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580256896 00000100:00100000:0.0:1784583984.332363:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580256896 00000100:00100000:0.0:1784583984.332523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 261 00000100:00100000:0.0:1784583984.332546:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+5:2397:x1871271580256896:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:0.0:1784583984.332582:0:6515:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47a24 00000100:00080000:0.0:1784583984.332592:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98b43eb02800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784583984.332619:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784583984.332774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf3f194e-6606-4f93-8d46-bda82242dfa1+3:2397:x1871271580256896:12345-192.168.203.51@tcp:39:umount.0 Request processed in 230us (538us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784583984.332782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 261 00010000:00010000:3.0:1784583984.332968:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784583984.333958:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784583984.365724:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583984.381351:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784583984.381428:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257152 00000100:00100000:3.0:1784583984.381438:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257152 00000100:00100000:3.0:1784583984.381574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 393 00000100:00100000:3.0:1784583984.381596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+7:2397:x1871271580257152:12345-192.168.203.51@tcp:251:umount.0 00000020:00000080:3.0:1784583984.381640:0:6506:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e478e2 00000020:00010000:3.0:1784583984.381648:0:6506:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b303a91000: total 0 00000100:00080000:3.0:1784583984.381651:0:6506:0:(import.c:65:import_set_state_nolock()) ffff98b303a97000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784583984.381731:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0d05096-428d-430e-97a4-2faca82157e3+3:2397:x1871271580257152:12345-192.168.203.51@tcp:251:umount.0 Request processed in 138us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583984.381739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 393 00000020:00010000:2.0:1784583984.381805:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b303a91000: total 0 00010000:00010000:2.0:1784583984.381810:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583984.381862:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b303a91000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784583984.381896:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b600/0xdab2421a42e479bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee1a6 expref: 2 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583984.381913:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b303a91000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784583984.381924:0:6503:0:(genops.c:906:class_export_put()) final put ffff98b303a91000/d0d05096-428d-430e-97a4-2faca82157e3 00010000:00010000:2.0:1784583984.381934:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583984.381936:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583984.381954:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784583984.381963:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303a91000/d0d05096-428d-430e-97a4-2faca82157e3 for MGS 00000020:00000080:2.0:1784583984.381994:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b303a97000 for MGS 00010000:00010000:1.0:1784583985.390064:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583985.838824:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599168000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784583985.838892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583985.838992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168000 00000100:00100000:3.0:1784583985.839000:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168000 00000100:00100000:3.0:1784583985.839049:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784583985.839058:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599168000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784583985.839088:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784583985.843424:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599168000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4357us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583985.843439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784583985.845339:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599168000:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1784583985.882302:0:15197:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784583985.908801:0:15197:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784583985.908853:0:15197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.908867:0:15197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.908875:0:15197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.908882:0:15197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.908961:0:15197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784583985.908968:0:15197:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784583985.908991:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784583985.908996:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784583985.909002:0:15197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784583985.909024:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b4178b6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784583985.909054:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599168128:0@lo:39:umount.0 00000100:00100000:3.0:1784583985.909115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583985.909514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168128 00000100:00100000:3.0:1784583985.909522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168128 00000100:00100000:3.0:1784583985.909567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784583985.909575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1871271599168128:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784583985.909599:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47507 00000100:00080000:3.0:1784583985.909607:0:6514:0:(import.c:65:import_set_state_nolock()) ffff98b42bade000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784583985.911016:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784583985.911029:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.911041:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583985.911045:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.911055:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583985.911064:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583985.911070:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784583985.911082:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784583985.911085:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784583985.911120:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.911127:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784583985.911149:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.911157:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e4798a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47991 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.911168:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583985.911170:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583985.911172:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583985.911183:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583985.911199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599168256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784583985.911252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583985.911300:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168256 00000100:00100000:1.0:1784583985.911305:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168256 00000100:00100000:1.0:1784583985.911353:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784583985.911360:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599168256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784583985.911372:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784583985.912589:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c000/0xdab2421a42e47991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4798a expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583985.912609:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784583985.912665:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43eade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599168256:12345-0@lo:103:ldlm_bl.0 Request processed in 1304us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583985.912673:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784583985.913454:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599168256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583985.913882:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1871271599168128:12345-0@lo:39:umount.0 Request processed in 4307us (4765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583985.913892:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1784583985.913901:0:6514:0:(genops.c:906:class_export_put()) final put ffff98b4178b7800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1784583985.913951:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b4178b6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784583985.913962:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599168128:0@lo:39:umount.0 00000100:00080000:3.0:1784583985.913980:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784583985.913984:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784583985.913988:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784583985.914153:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4178b7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784583985.914196:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b42bade000 for lustre-MDT0000 00010000:00010000:2.0:1784583985.915155:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583985.915719:0:15197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915751:0:15197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915759:0:15197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915765:0:15197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915816:0:15197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784583985.915824:0:15197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915830:0:15197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915835:0:15197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.915841:0:15197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.915877:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784583985.915884:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.915891:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583985.915895:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.915904:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583985.915911:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583985.915917:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784583985.915919:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784583985.915960:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.915967:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583985.915988:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.915996:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1d200/0xdab2421a42e47998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4799f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916016:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583985.916020:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916026:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583985.916029:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916036:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583985.916043:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583985.916048:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784583985.916051:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1784583985.916062:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916068:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583985.916083:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916091:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.916092:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.916094:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583985.916109:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599168384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583985.916169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583985.916225:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599168512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583985.916254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583985.916300:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168384 00000100:00100000:2.0:1784583985.916307:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168384 00000100:00100000:2.0:1784583985.916346:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168512 00000100:00100000:2.0:1784583985.916349:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168512 00000100:00100000:2.0:1784583985.916371:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784583985.916379:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+24:3640:x1871271599168384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583985.916404:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583985.916418:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983c00/0xdab2421a42e4799f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47998 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916431:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583985.916461:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+23:3640:x1871271599168384:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583985.916493:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784583985.916510:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784583985.916516:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+22:3641:x1871271599168512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583985.916524:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583985.916532:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b44216a200/0xdab2421a42e478a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4789c expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916541:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583985.916565:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3641:x1871271599168512:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583985.916571:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784583985.916606:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599168512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583985.916626:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48a91d92-bcef-47e2-812f-ada1e5d741c7:3640:1871271599168384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583985.916874:0:15197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784583985.916880:0:15197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b000/0xdab2421a42e4789c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e478a3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583985.916891:0:15197:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784583985.916899:0:15197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.916914:0:15197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.916920:0:15197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.916928:0:15197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916959:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583985.916964:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916970:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583985.916973:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.916979:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583985.916986:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583985.916990:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784583985.916993:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784583985.917009:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917014:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583985.917027:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917035:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.917036:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.917038:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583985.917047:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599168640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583985.917073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583985.917108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168640 00000100:00100000:2.0:1784583985.917111:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168640 00000100:00100000:2.0:1784583985.917144:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784583985.917150:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+21:3642:x1871271599168640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583985.917157:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583985.917166:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce000/0xdab2421a42e47bf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47bf2 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917175:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583985.917202:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:3642:x1871271599168640:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583985.917208:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784583985.917233:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599168640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583985.917358:0:15197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784583985.917363:0:15197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172cf600/0xdab2421a42e47bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47bf9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583985.917372:0:15197:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784583985.917379:0:15197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.917398:0:15197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.917405:0:15197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583985.917412:0:15197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917553:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583985.917558:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917565:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b400030200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583985.917568:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917576:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583985.917583:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583985.917587:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784583985.917589:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1784583985.917603:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917619:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583985.917633:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917641:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.917642:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.917644:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583985.917654:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599168768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583985.917678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583985.917712:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168768 00000100:00100000:2.0:1784583985.917716:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168768 00000100:00100000:2.0:1784583985.917740:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784583985.917747:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+20:3639:x1871271599168768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784583985.917755:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784583985.917764:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983400/0xdab2421a42e4745f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47458 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583985.917774:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784583985.917800:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3639:x1871271599168768:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583985.917806:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784583985.917829:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599168768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583985.917920:0:15197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784583985.917925:0:15197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b400030200/0xdab2421a42e47458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4745f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583985.917956:0:15197:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1784583985.917960:0:15197:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784583985.917962:0:15197:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1784583985.917993:0:15197:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784583985.917997:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1784583985.918001:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784583985.918006:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1784583985.918011:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b303769800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784583985.918016:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b302436800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784583985.918021:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b43ca6d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784583985.918025:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b43e5be800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1784583985.918032:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98b43eb02000 cf3f194e-6606-4f93-8d46-bda82242dfa1 192.168.203.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784583985.918037:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98b303a90000 bfe5cd00-263a-47c1-b0c6-0ab6049cb709 192.168.203.51@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:3.0:1784583985.918043:0:15197:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98b4331e19c0) has exports, disconnecting them 00000020:00080000:3.0:1784583985.918047:0:15197:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b303769800), last request at 1784583982 00000020:00000080:3.0:1784583985.918053:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47809 00000100:00080000:3.0:1784583985.918068:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b30376e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784583985.918091:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583985.918175:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784583985.918360:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b303769800): rc 0 00000020:00000080:3.0:1784583985.918363:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b303769800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784583985.918673:0:15197:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b302436800), last request at 1784583982 00000020:00000080:3.0:1784583985.918678:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e476e3 00000100:00080000:3.0:1784583985.918684:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b302432000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784583985.918702:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302436800): rc 0 00000020:00000080:3.0:1784583985.918704:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b302436800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1784583985.918728:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784583985.918752:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303769800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784583985.918798:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30376e000 for lustre-MDT0000 00000020:00080000:3.0:1784583985.918956:0:15197:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b43ca6d800), last request at 1784583762 00000020:00000080:3.0:1784583985.918977:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e475e0 00000100:00080000:3.0:1784583985.918982:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b43ca6a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784583985.919001:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b43ca6d800): rc 0 00000020:00000080:3.0:1784583985.919003:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b43ca6d800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1784583985.919064:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784583985.919082:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302436800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784583985.919139:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302432000 for lustre-MDT0000 00000020:00080000:3.0:1784583985.919179:0:15197:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b43e5be800), last request at 1784583762 00000020:00000080:3.0:1784583985.919184:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e475af 00000100:00080000:3.0:1784583985.919188:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b43ca6a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784583985.919196:0:15197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1784583985.919272:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b43e5be800): rc 0 00000004:00000080:3.0:1784583985.919278:0:15197:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb9d416f7ae0 00000100:00080000:3.0:1784583985.919364:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784583985.919368:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:2.0:1784583985.920521:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca6d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784583985.920559:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca6a800 for lustre-MDT0000 00010000:00010000:2.0:1784583985.920570:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784583985.920729:0:15197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784583985.920754:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b43ca65800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784583985.920801:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599168896:0@lo:39:umount.0 00000100:00100000:2.0:1784583985.920862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583985.920982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599168896 00000100:00100000:0.0:1784583985.920989:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599168896 00000100:00100000:0.0:1784583985.921037:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784583985.921046:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599168896:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784583985.921070:0:6520:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4763b 00000100:00080000:0.0:1784583985.921077:0:6520:0:(import.c:65:import_set_state_nolock()) ffff98b43e717800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784583985.921095:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1784583985.921378:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3638:x1871271599168896:12345-0@lo:39:umount.0 Request processed in 332us (514us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784583985.922546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:0.0:1784583985.922583:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784583985.922741:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ca65800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784583985.922751:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599168896:0@lo:39:umount.0 00000100:00080000:3.0:1784583985.923235:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784583985.923239:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1784583985.923254:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784583985.923874:0:15197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784583985.923898:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784583985.923957:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599169024:0@lo:9:umount.0 00000100:00100000:0.0:1784583985.924031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583985.924094:0:11860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169024 00000100:00100000:1.0:1784583985.924101:0:11860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169024 00000100:00100000:1.0:1784583985.924163:0:11860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784583985.924171:0:11860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599169024:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784583985.924193:0:11860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4778b 00000100:00080000:1.0:1784583985.924200:0:11860:0:(import.c:65:import_set_state_nolock()) ffff98b30245e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784583985.924235:0:11860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:2.0:1784583985.924364:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784583985.924375:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784583985.924450:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784583985.924453:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1784583985.924525:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784583985.924584:0:15197:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784583985.924594:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b303a97800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784583985.924667:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599169152:0@lo:9:umount.0 00000100:00100000:0.0:1784583985.924694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583985.924742:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169152 00000100:00100000:2.0:1784583985.924747:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169152 00000100:00100000:2.0:1784583985.924776:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784583985.924782:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599169152:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784583985.924794:0:8428:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e478cd 00000100:00080000:2.0:1784583985.924799:0:8428:0:(import.c:65:import_set_state_nolock()) ffff98b42f7d8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583985.924823:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784583985.924888:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3638:x1871271599169152:12345-0@lo:9:umount.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583985.924894:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1784583985.924910:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784583985.924915:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583985.924975:0:11860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3638:x1871271599169024:12345-0@lo:9:umount.0 Request processed in 805us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583985.924982:0:11860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1784583985.925037:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784583985.925052:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784583985.925054:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583985.925057:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599169024:0@lo:9:umount.0 00000100:00080000:0.0:1784583985.925079:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b303a97800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784583985.925090:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784583985.925091:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583985.925094:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599169152:0@lo:9:umount.0 00000020:00080000:3.0:1784583985.925240:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98b4331e19c0) has no exports 00000020:00080000:0.0:1784583985.934680:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98b4331e19c0) has no exports 00000020:00000080:0.0:1784583985.979870:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e474b3 00000020:00000080:0.0:1784583985.979886:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049c5000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784583985.979961:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784583985.980035:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049c5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1784583985.980061:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784583985.980072:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784583985.980076:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98b4331a99c0) has no exports 00000020:00000080:1.0:1784583985.980504:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e474ac 00000020:00000080:1.0:1784583985.980510:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b43c89f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784583985.980539:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43c89f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784583985.980563:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583985.980571:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784583985.980573:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b404991000/lustre-QMT0000_UUID 00000020:00000080:1.0:1784583985.980576:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b404991000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784583985.980580:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1784583986.413675:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784583987.054217:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784583987.373709:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599169536:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.373781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583987.373860:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170048:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.373886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583987.373903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169536 00000100:00100000:1.0:1784583987.373911:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169536 00000100:00100000:0.0:1784583987.373916:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784583987.373933:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599169408:0@lo:400:kworker.0 00000100:00100000:1.0:1784583987.373966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784583987.373968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583987.373977:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1871271599169536:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784583987.373986:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784583987.373997:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599169920:0@lo:400:kworker.0 00000100:00100000:2.0:1784583987.374071:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599169664:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.378280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583987.378785:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170432:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.378954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583987.379010:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169920 00000100:00100000:0.0:1784583987.379017:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169920 00000100:00100000:1.0:1784583987.379051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1871271599169536:12345-0@lo:400:kworker.0 Request processed in 5072us (5267us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784583987.379063:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784583987.379113:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170048 00000100:00100000:1.0:1784583987.379118:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170048 00000100:00100000:1.0:1784583987.379217:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170432 00000100:00100000:1.0:1784583987.379221:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170432 00000100:00100000:1.0:1784583987.379249:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784583987.379257:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583987.379378:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170048:12345-0@lo:400:kworker.0 Request processed in 120us (5491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583987.379385:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784583987.379440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583987.379463:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599170176:0@lo:400:kworker.0 00000100:00100000:2.0:1784583987.379503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583987.379559:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169664 00000100:00100000:0.0:1784583987.379564:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169664 00000100:00100000:0.0:1784583987.379578:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170176 00000100:00100000:0.0:1784583987.379581:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170176 00000100:00100000:2.0:1784583987.379591:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784583987.379594:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1784583987.379603:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599169280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784583987.379605:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599169920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784583987.379636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583987.379663:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43eadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599169792:0@lo:400:kworker.0 00000100:00100000:2.0:1784583987.379682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583987.379690:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599170304:0@lo:400:kworker.0 00000100:00100000:2.0:1784583987.379705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583987.379896:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599169920:12345-0@lo:400:kworker.0 Request processed in 46us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583987.379905:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1784583987.379918:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169792 00000100:00100000:0.0:1784583987.379921:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169792 00000100:00100000:0.0:1784583987.379941:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170304 00000100:00100000:0.0:1784583987.379944:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170304 00000100:00100000:0.0:1784583987.379959:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1784583987.379964:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599170304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.379996:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599170304:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784583987.380003:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1784583987.380015:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784583987.380019:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599169664:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784583987.380024:0:9809:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784583987.380048:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784583987.380050:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599169664:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784583987.380058:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784583987.380063:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.380072:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784583987.380102:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170432:12345-0@lo:400:kworker.0 Request processed in 45us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583987.380109:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784583987.380136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169408 00000100:00100000:3.0:1784583987.380140:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169408 00000100:00100000:3.0:1784583987.380171:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1784583987.380177:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3642:x1871271599169408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583987.380215:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583987.380246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784583987.380346:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437698a80 x1871271599170304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784583987.380346:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43eadc700 x1871271599169920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583987.380360:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599170304:0@lo:400:kworker.0 00000100:00100000:1.0:1784583987.380360:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599169920:0@lo:400:kworker.0 00000100:00080000:2.0:1784583987.380370:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1784583987.380371:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170432:0@lo:400:kworker.0 00000100:00080000:2.0:1784583987.380375:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784583987.380379:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1784583987.380379:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170048:0@lo:400:kworker.0 00000100:00080000:1.0:1784583987.380387:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784583987.380390:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784583987.380393:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784583987.380397:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784583987.380401:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 205 00000100:00080000:1.0:1784583987.380406:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b43ca61800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784583987.380417:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599170176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784583987.380423:0:9809:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784583987.380449:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599170176:12345-0@lo:400:kworker.0 Request processed in 32us (945us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784583987.380454:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784583987.380481:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784583987.380486:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599169792:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784583987.380490:0:9809:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784583987.380515:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871271599169792:12345-0@lo:400:kworker.0 Request processed in 28us (832us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784583987.380521:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784583987.380540:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303960700 x1871271599170688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784583987.380562:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583987.380567:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784583987.380571:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784583987.380575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599169536:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.380590:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599170688:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784583987.380630:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599169280 00000100:00100000:1.0:1784583987.380635:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599169280 00000100:00100000:1.0:1784583987.380659:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170560 00000100:00100000:1.0:1784583987.380662:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170560 00000100:00100000:1.0:1784583987.380676:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784583987.380683:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599169280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583987.380703:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784583987.380736:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599169280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583987.380742:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784583987.380754:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784583987.380761:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583987.380774:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784583987.380802:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599170560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583987.380809:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784583987.380846:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599170560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784583987.381313:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41e64cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48a91d92-bcef-47e2-812f-ada1e5d741c7+19:3642:x1871271599169408:12345-0@lo:400:kworker.0 Request processed in 1135us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583987.381320:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1784583987.381358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583987.381385:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599169408:0@lo:400:kworker.0 00000100:00100000:3.0:1784583987.381817:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170688 00000100:00100000:3.0:1784583987.381823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170688 00000100:00100000:3.0:1784583987.381849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784583987.381854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599170688:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784583987.381868:0:6520:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784583987.399966:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599170688:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 18097us (19325us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784583987.399980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1784583987.400170:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583987.400177:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583987.400182:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599170688:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1784583987.407283:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583987.407296:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 205 00000100:00080000:2.0:1784583987.407306:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98b43e717000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583987.407347:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efaaa00 x1871271599170816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784583987.407374:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599169664:0@lo:400:kworker.0 00000100:00080000:2.0:1784583987.407406:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784583987.407410:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784583987.407414:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784583987.407417:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583987.407420:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 243 00000100:00080000:2.0:1784583987.407424:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b30376b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583987.407437:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b30499aa00 x1871271599170944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784583987.407462:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599170176:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.407598:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599170816:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784583987.407658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583987.407986:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170816 00000100:00100000:3.0:1784583987.407994:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170816 00000100:00100000:3.0:1784583987.408038:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784583987.408046:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599170816:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1784583987.408063:0:9809:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784583987.408116:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599170816:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 69us (457us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784583987.408129:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784583987.408819:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599170944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784583987.408858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784583987.408934:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583987.408940:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583987.408944:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599170816:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784583987.408982:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599170944 00000100:00100000:3.0:1784583987.408988:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599170944 00000100:00100000:3.0:1784583987.409022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784583987.409028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599170944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1784583987.409039:0:6516:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784583987.409074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599170944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784583987.409080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1784583987.409210:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583987.409215:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583987.409218:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599170944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784583987.413405:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599169280:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784583987.413426:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784583987.413431:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784583987.413435:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784583987.413440:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583987.413444:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 224 00000100:00080000:2.0:1784583987.413451:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b30271c000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583987.413500:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b304998a80 x1871271599171072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784583987.413532:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43eadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599169792:0@lo:400:kworker.0 00000100:00100000:0.0:1784583987.413681:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599171072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784583987.413761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583987.414054:0:9809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171072 00000100:00100000:3.0:1784583987.414061:0:9809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171072 00000100:00100000:3.0:1784583987.414171:0:9809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784583987.414179:0:9809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599171072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1784583987.414195:0:9809:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784583987.414250:0:9809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599171072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (489us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784583987.414258:0:9809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1784583987.414288:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784583987.414293:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784583987.414296:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599171072:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1784583987.437772:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583988.461688:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784583988.912830:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784583988.912839:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b30245f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784583988.912922:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583988.912928:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b437662000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000001:00100000:1.0:1784583988.913209:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784583988.913220:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1784583988.913234:0:7445:0:(genops.c:906:class_export_put()) final put ffff98b43e710800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784583988.915301:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30245f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784583988.915354:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30245e800 for lustre-OST0000 00000020:00000080:2.0:1784583988.915872:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b437662000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-OST0000 00000020:00000080:2.0:1784583988.915906:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b437661000 for lustre-OST0000 00000001:00100000:0.0:1784583988.916074:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784583988.916079:0:9507:0:(genops.c:906:class_export_put()) final put ffff98b42f7dc800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784583988.916098:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:0.0:1784583988.916101:0:9507:0:(genops.c:906:class_export_put()) final put ffff98b418037800/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:2.0:1784583988.916147:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b42f7dc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784583988.916172:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b418037800/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-OST0001 00000020:00000080:2.0:1784583988.916186:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b42f7d8000 for lustre-OST0001 00000020:00000080:2.0:1784583988.916189:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3041fa000 for lustre-OST0001 00000001:00100000:1.0:1784583988.916707:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00080000:1.0:1784583988.916716:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1784583988.916719:0:7445:0:(genops.c:906:class_export_put()) final put ffff98b43eb06000/cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00100000:1.0:1784583988.916725:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000001:00080000:1.0:1784583988.916729:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1784583988.916732:0:7445:0:(genops.c:906:class_export_put()) final put ffff98b303a95800/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583988.916739:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e710800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784583988.916791:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb06000/cf3f194e-6606-4f93-8d46-bda82242dfa1 for lustre-MDT0001 00000020:00000080:3.0:1784583988.916812:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303a95800/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-MDT0001 00000020:00000080:3.0:1784583988.916832:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43e717800 for lustre-MDT0001 00000020:00000080:3.0:1784583988.916836:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43eb02800 for lustre-MDT0001 00000001:00100000:1.0:1784583988.917218:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784583988.917222:0:6493:0:(genops.c:906:class_export_put()) final put ffff98b43e5be800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1784583988.917381:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00080000:1.0:1784583988.917390:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1784583988.917393:0:6493:0:(genops.c:906:class_export_put()) final put ffff98b43eb02000/cf3f194e-6606-4f93-8d46-bda82242dfa1 00000001:00100000:1.0:1784583988.917645:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000001:00080000:1.0:1784583988.917650:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1784583988.917657:0:6493:0:(genops.c:906:class_export_put()) final put ffff98b303a90000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 00000020:00000080:3.0:1784583988.917789:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b303a96800 for lustre-MDT0001 00000020:00000080:3.0:1784583988.917811:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e5be800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1784583988.917923:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb02000/cf3f194e-6606-4f93-8d46-bda82242dfa1 for lustre-MDT0000 00000020:00000080:3.0:1784583988.918021:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303a90000/bfe5cd00-263a-47c1-b0c6-0ab6049cb709 for lustre-MDT0000 00000020:00000080:3.0:1784583988.918134:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca6a000 for lustre-MDT0000 00000020:00000080:3.0:1784583988.918140:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43eb04000 for lustre-MDT0000 00000020:00000080:3.0:1784583988.918143:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b303a93800 for lustre-MDT0000 00010000:00010000:2.0:1784583989.490602:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583990.511458:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583991.533798:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784583992.047816:0:15197:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b303929e40 - data ffff98b41df0ea20/ffff98b30383bc00 00000020:01000000:3.0:1784583992.047947:0:15197:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b43c97ee40 - data ffff98b41dd600d8/ffff98b43c9f8000 00000001:00000004:3.0:1784583992.057806:0:15197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1784583992.113024:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784583992.113033:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1784583992.113048:0:15197:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98b3048a5f80 x1871271599168896/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784583995 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784583992.113080:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784583992.115391:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784583992.115397:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1784583992.115756:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784583992.115759:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784583992.116730:0:8798:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784583992.116737:0:8798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1784583992.116764:0:8798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1784583992.118038:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784583992.118045:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1784583992.118065:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784583992.118068:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784583992.118303:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784583992.118307:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1784583992.118317:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1784583992.119865:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4747b 00000020:00000080:1.0:1784583992.119878:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784583992.125029:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784583992.127277:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47490 00000020:00000080:0.0:1784583992.127293:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784583992.127367:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784583992.127377:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583992.127385:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784583992.127389:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98b4331e4d40) has no exports 00000004:01000000:0.0:1784583992.127652:0:15197:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784583992.127662:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e478c6 00000020:00000080:0.0:1784583992.127669:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b42f7db800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784583992.127843:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784583992.127954:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784583992.127959:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583992.127972:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784583992.127975:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff98b4071ab380) has no exports 00000020:00000080:0.0:1784583992.127982:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e478bf 00000020:00000080:0.0:1784583992.127987:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b303a96000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784583992.128011:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b42f7db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1784583992.129397:0:15197:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784583992.129405:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784583992.129420:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1784583992.129426:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583992.129429:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784583992.129679:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303a96000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784583992.129690:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b303a97800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784583992.129903:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583992.129916:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784583992.129920:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b30271c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784583992.129923:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30271c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784583992.129929:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784583992.130017:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47784 00000020:00000080:0.0:1784583992.130023:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b417150000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784583992.130141:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b417150000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784583992.132125:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784583992.132135:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583992.132149:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784583992.132155:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98b3024799c0) has no exports 00000020:00000080:0.0:1784583992.132164:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4777d 00000020:00000080:0.0:1784583992.132172:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b302b0b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784583992.132275:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784583992.132767:0:15197:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784583992.132771:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784583992.132775:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1784583992.132780:0:15197:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583992.132782:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784583992.133643:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583992.133657:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784583992.133671:0:15197:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784583992.133678:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47634 00000020:00000080:0.0:1784583992.133685:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b43e9ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784583992.134635:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302b0d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784583992.134647:0:38:0:(genops.c:906:class_export_put()) final put ffff98b302b09800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784583992.134650:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b09800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1784583992.134658:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784583992.134950:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784583992.134955:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784583992.134956:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e9ac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784583992.134963:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784583992.134967:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98b4071a99c0) has no exports 00000020:00000080:0.0:1784583992.134975:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4762d 00000020:00000080:0.0:1784583992.134981:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b43ca67800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784583992.135287:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca67800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784583992.137564:0:15197:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784583992.137571:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784583992.137575:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1784583992.137583:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784583992.137621:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca65800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784583992.137665:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583992.137677:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784583992.137682:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b417154000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784583992.137685:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b417154000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784583992.137695:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784583992.137790:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583992.137794:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784583992.137796:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b42ba29000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784583992.137799:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b42ba29000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784583992.137803:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784583992.137856:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47497 00000020:00000080:1.0:1784583992.138425:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d4800/lustre-MDD0000_UUID 00000020:00000080:2.0:1784583992.138629:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784583992.138801:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784583992.138823:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784583992.138831:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784583992.138835:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98b4049d99c0) has no exports 00000020:00000080:1.0:1784583992.138996:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583992.139002:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784583992.139005:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d3000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784583992.139008:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784583992.139017:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784583992.139077:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4749e 00000020:00000080:1.0:1784583992.139083:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784583992.139130:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1784583992.139781:0:15197:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b418942800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784583992.139787:0:15197:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b418942800 3 00000020:01000004:1.0:1784583992.139792:0:15197:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b418942800 from lustre-MDT0000 00000020:00000080:1.0:1784583992.139829:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583992.139834:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784583992.139838:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1784583992.139841:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784583992.139859:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784583992.140396:0:15197:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784583992.140400:0:15197:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784583992.140419:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784583992.140423:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784583992.140427:0:15197:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784583992.140433:0:15197:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98b40a536800 48a91d92-bcef-47e2-812f-ada1e5d741c7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784583992.140440:0:15197:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98b4331e0000) has exports, disconnecting them 00000020:00080000:1.0:1784583992.140444:0:15197:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98b40a536800), last request at 1784583743 00000020:00000080:1.0:1784583992.140483:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4743c 00000020:00010000:1.0:1784583992.140488:0:15197:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b40a536800: total 0 00000100:00080000:1.0:1784583992.140492:0:15197:0:(import.c:65:import_set_state_nolock()) ffff98b40a532000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784583992.140506:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b40a536800): rc 0 00000020:00080000:1.0:1784583992.140509:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98b4331e0000) has no exports 00000020:00010000:2.0:1784583992.140619:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b40a536800: total 0 00010000:00010000:2.0:1784583992.140665:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b40a536800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784583992.140697:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983200/0xdab2421a42e479ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e479a6 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140721:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a800/0xdab2421a42e4793d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47936 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140729:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c600/0xdab2421a42e47beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47be4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140736:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982a00/0xdab2421a42e4794b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47944 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140742:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97400/0xdab2421a42e4785d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47856 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140751:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c400/0xdab2421a42e47959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47952 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140757:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982200/0xdab2421a42e47975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4796e expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140763:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c800/0xdab2421a42e47967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47960 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140769:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b400030000/0xdab2421a42e47546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4753f expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140775:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97e00/0xdab2421a42e47bcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47bc8 expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140780:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce800/0xdab2421a42e47bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47bd6 expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140801:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97800/0xdab2421a42e47983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e4797c expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140813:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b400031000/0xdab2421a42e47538 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e47531 expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583992.140824:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b40a536800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784583992.140837:0:6502:0:(genops.c:906:class_export_put()) final put ffff98b40a536800/48a91d92-bcef-47e2-812f-ada1e5d741c7 00010000:00010000:2.0:1784583992.140849:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583992.140852:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583992.140854:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784583992.140861:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b40a536800/48a91d92-bcef-47e2-812f-ada1e5d741c7 for MGS 00000020:00000080:2.0:1784583992.140886:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b40a532000 for MGS 00000100:00100000:3.0:1784583992.141339:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98b4172b6c00:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1784583992.141339:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98b4172b7e00:6508] 2 exiting: rc = 0 00000100:00100000:3.0:1784583992.141434:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98b42c710c00:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1784583992.141960:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141970:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141976:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141981:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141987:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141993:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.141998:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142004:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142010:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142017:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142023:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142029:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142035:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142041:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142045:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142051:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142055:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142061:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142066:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142080:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142085:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142091:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142097:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142102:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142107:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142112:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142118:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142122:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142127:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142132:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142138:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142142:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142147:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142153:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142158:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142163:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142169:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142174:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142179:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142184:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142190:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142195:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142200:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142205:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.142210:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143726:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143740:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143747:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143754:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143761:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143768:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143775:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143781:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143787:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143812:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143818:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143824:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143830:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143836:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143842:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143850:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.143859:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.145000:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583992.145010:0:15197:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1784583992.153674:0:15197:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b303929180 - data ffff98b41df0e510/ffff98b30383ac00 00000020:01000000:1.0:1784583992.156254:0:15197:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b41813a8a0 - data ffff98b41dc0e6c0/ffff98b40a5fc400 00000020:00000080:1.0:1784583992.156804:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47420 00000020:00000080:1.0:1784583992.156813:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b416bda000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784583992.156825:0:15197:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b418942800 from MGS, refs=2 00000020:01000004:1.0:1784583992.156829:0:15197:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b418942800 2 00000020:01000004:1.0:1784583992.156832:0:15197:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b418942800 from MGS 00000020:00000080:1.0:1784583992.156852:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583992.156859:0:15197:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784583992.156874:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b416bd9800/MGS 00000020:00000080:1.0:1784583992.156877:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b416bd9800/MGS for MGS 00000020:01000000:1.0:1784583992.156883:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784583992.156950:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784583992.156955:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784583992.156961:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784583992.156967:0:15197:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98b4049d7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784583992.156973:0:15197:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff98b4049d8000) has exports, disconnecting them 00000020:00080000:1.0:1784583992.156977:0:15197:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98b4049d7000), last request at 1784583743 00000020:00000080:1.0:1784583992.156982:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e474eb 00000020:00080000:1.0:1784583992.156991:0:15197:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b4049d7000): rc 0 00000020:00000080:1.0:1784583992.156995:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784583992.158440:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b416bda000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784583992.158492:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784583992.159817:0:15197:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784583992.159824:0:15197:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784583992.159828:0:15197:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784583992.159834:0:15197:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784583992.159870:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b4178b6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784583992.159994:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784583992.160002:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1784583992.160007:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b4049d2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784583992.160010:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1784583992.160016:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784583992.160097:0:15197:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b418942800 1 00000020:00000080:2.0:1784583992.160117:0:15197:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47412 00000020:00000080:2.0:1784583992.160123:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b416bdd800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784583992.160132:0:15197:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784583992.160140:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b416bdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784583992.160149:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784583992.160153:0:15197:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784583992.160156:0:15197:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98b4071acd40) has no exports 00000020:00000080:2.0:1784583992.192959:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784583992.192971:0:15197:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784583992.192977:0:15197:0:(genops.c:906:class_export_put()) final put ffff98b40a3ab800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784583992.192981:0:15197:0:(genops.c:865:class_export_destroy()) destroying export ffff98b40a3ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784583992.192989:0:15197:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784583992.193147:0:15197:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b40a3af800 00000020:02000400:2.0:1784583992.193204:0:15197:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1784583992.493757:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784583992.493771:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784583992.493775:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583992.493783:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1784583992.493788:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784583992.493795:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b43ca61800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583992.493817:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b30499b480 x1871271599171456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784583992.493837:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784583992.493840:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784583992.493842:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583992.493845:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1784583992.493848:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784583992.493852:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98b43e717000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583992.493879:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b304999c00 x1871271599171584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784583992.493898:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784583992.493902:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784583992.493903:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583992.493907:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1784583992.493909:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784583992.493914:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b30271c000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583992.493924:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b30499ad80 x1871271599171712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784583992.493949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784583992.493952:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784583992.493953:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784583992.493956:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1784583992.493958:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784583992.493961:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b30376b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784583992.493970:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b30499aa00 x1871271599172096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784583992.494455:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599171456:0@lo:38:kworker.0 00000100:00100000:0.0:1784583992.494557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583992.494608:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599171584:0@lo:38:kworker.0 00000100:00100000:0.0:1784583992.494632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583992.494655:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599171712:0@lo:38:kworker.0 00000100:00100000:0.0:1784583992.494675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583992.494695:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599172096:0@lo:38:kworker.0 00000100:00100000:0.0:1784583992.494714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583992.494753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171584 00000100:00100000:0.0:1784583992.494773:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171584 00000100:00100000:0.0:1784583992.494803:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171712 00000100:00100000:0.0:1784583992.494806:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171712 00000100:00100000:0.0:1784583992.494814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172096 00000100:00100000:0.0:1784583992.494816:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172096 00000100:00100000:0.0:1784583992.494827:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784583992.494834:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599171584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784583992.494853:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784583992.494903:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599171584:12345-0@lo:38:kworker.0 Request processed in 56us (257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784583992.494910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784583992.494926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784583992.494929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599171712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784583992.494943:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784583992.494967:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599171712:12345-0@lo:38:kworker.0 Request processed in 35us (290us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784583992.494973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784583992.494995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784583992.494999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599172096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784583992.495008:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784583992.495032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599172096:12345-0@lo:38:kworker.0 Request processed in 31us (317us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784583992.495038:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1784583992.495079:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583992.495084:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583992.495087:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599171584:0@lo:38:kworker.0 00000100:00080000:0.0:1784583992.495097:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583992.495100:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583992.495103:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599171712:0@lo:38:kworker.0 00000100:00080000:0.0:1784583992.495110:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583992.495113:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583992.495115:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599172096:0@lo:38:kworker.0 00000100:00100000:2.0:1784583992.496494:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171456 00000100:00100000:2.0:1784583992.496504:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171456 00000100:00100000:2.0:1784583992.496541:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784583992.496548:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599171456:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784583992.496567:0:6519:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784583992.496638:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599171456:12345-0@lo:38:kworker.0 Request processed in 88us (2080us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784583992.496656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784583992.496757:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599171200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784583992.496812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583992.496839:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599171328:0@lo:400:kworker.0 00000400:00000100:1.0:1784583992.496857:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599171328 offset 0 length 224: 4 00000100:00100000:1.0:1784583992.496878:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599172352:0@lo:400:kworker.0 00000100:00080000:0.0:1784583992.496916:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784583992.496921:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784583992.496924:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599171456:0@lo:38:kworker.0 00000100:00100000:0.0:1784583992.497223:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599171968:0@lo:400:kworker.0 00000100:00100000:0.0:1784583992.498699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583992.498877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583992.498878:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171968 00000100:00100000:2.0:1784583992.498886:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171968 00000100:00100000:1.0:1784583992.498924:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784583992.498934:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599171840:0@lo:400:kworker.0 00000100:00100000:2.0:1784583992.498953:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172352 00000100:00100000:2.0:1784583992.498958:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172352 00000100:00100000:1.0:1784583992.498970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583992.498986:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784583992.498995:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599171968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784583992.499006:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583992.499034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583992.499097:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784583992.499108:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599172352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583992.499145:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599172352:12345-0@lo:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583992.499152:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784583992.499210:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583992.499219:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599172224:0@lo:400:kworker.0 00000100:00100000:0.0:1784583992.499242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784583992.499360:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599172352:0@lo:400:kworker.0 00000100:00100000:1.0:1784583992.499389:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171200 00000100:00100000:1.0:1784583992.499393:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171200 00000100:00100000:1.0:1784583992.499417:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172480 00000100:00100000:1.0:1784583992.499421:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172480 00000100:00100000:1.0:1784583992.499434:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784583992.499440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599171200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784583992.499461:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784583992.499569:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599171840 00000100:00100000:3.0:1784583992.499573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599171840 00000100:00100000:3.0:1784583992.499600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172224 00000100:00100000:3.0:1784583992.499602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172224 00000100:00100000:3.0:1784583992.499617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784583992.499622:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599171840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583992.499657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599171840:12345-0@lo:400:kworker.0 Request processed in 34us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583992.499663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784583992.499675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784583992.499680:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599172224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784583992.499719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599172224:12345-0@lo:400:kworker.0 Request processed in 39us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784583992.499725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1784583992.499769:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1871271599171968:12345-0@lo:400:kworker.0 Request processed in 773us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583992.499777:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784583992.499859:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599171968:0@lo:400:kworker.0 00010000:00080000:0.0:1784583992.499885:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b437698a80 x1871271599172224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784583992.499907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599172224:0@lo:400:kworker.0 00000100:00080000:0.0:1784583992.499928:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784583992.499933:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784583992.499935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583992.500084:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599171200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 643us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583992.500091:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784583992.500109:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784583992.500116:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599172480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784583992.500131:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784583992.500156:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599172480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784583992.500169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00080000:1.0:1784583992.500209:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304998380 x1871271599171840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784583992.500219:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599171840:0@lo:400:kworker.0 00000100:00100000:1.0:1784583992.500234:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784583992.500247:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599171200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784583992.557671:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583993.581969:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583994.606660:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784583995.239528:0:15398:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784583995.265221:0:15398:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1784583995.265282:0:15398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.265299:0:15398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.265306:0:15398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.265313:0:15398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.265349:0:15398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784583995.265355:0:15398:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784583995.265389:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784583995.265393:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784583995.265399:0:15398:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784583995.265404:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b43e717000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1784583995.265409:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784583995.265411:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784583995.265426:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784583995.265489:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784583995.265497:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583995.265506:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1de00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784583995.265510:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583995.265519:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784583995.265527:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784583995.265533:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784583995.265535:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784583995.265538:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784583995.265570:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583995.265587:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784583995.265616:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583995.265623:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1de00/0xdab2421a42e4796e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784583995.265634:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583995.265636:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583995.265637:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784583995.265652:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599172608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583995.265709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583995.265768:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172608 00000100:00100000:2.0:1784583995.265774:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172608 00000100:00100000:2.0:1784583995.265805:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784583995.265812:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1871271599172608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784583995.265817:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784583995 with bad export cookie 15758730726681637948 00010000:00010000:0.0:1784583995.266349:0:15398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266359:0:15398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266366:0:15398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266373:0:15398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266392:0:15398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784583995.266399:0:15398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266406:0:15398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266412:0:15398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266419:0:15398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266433:0:15398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784583995.266437:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784583995.266440:0:15398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266446:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266449:0:15398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266457:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583995.266464:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266495:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583995.266504:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583995.266510:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784583995.266513:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1784583995.266530:0:15398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266534:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266539:0:15398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266547:0:15398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784583995.266553:0:15398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266559:0:15398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266565:0:15398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266570:0:15398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583995.266576:0:15398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1784583995.266579:0:15398:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1784583995.266582:0:15398:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1784583995.266602:0:15398:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1784583995.266605:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1784583995.266611:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1784583995.266618:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1784583995.266618:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784583995.266626:0:15398:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98b30376f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784583995.266634:0:15398:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98b302719000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784583995.266640:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266657:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e4797c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47983 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784583995.266657:0:15398:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff98b4331ab380) has exports, disconnecting them 00000020:00080000:0.0:1784583995.266665:0:15398:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98b30376f800), last request at 1784583992 00000020:00000080:0.0:1784583995.266673:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4781e 00010000:00010000:1.0:1784583995.266674:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784583995.266679:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266686:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a200 already unused, calling callback (ffffffffc1439c20) 00000100:00080000:0.0:1784583995.266689:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b30376e800 : changing import state from FULL to CLOSED 10000000:00010000:1.0:1784583995.266690:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266700:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583995.266708:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784583995.266713:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784583995.266715:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784583995.266718:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784583995.266733:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784583995.266735:0:15398:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b30376f800): rc 0 00000020:00000080:0.0:1784583995.266740:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b30376f800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:1.0:1784583995.266744:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1784583995.266755:0:15398:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98b302719000), last request at 1784583992 00000020:00000080:0.0:1784583995.266760:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e476f8 00010000:00010000:1.0:1784583995.266763:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784583995.266766:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b30271d000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784583995.266780:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:1.0:1784583995.266791:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a200/0xdab2421a42e47856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e4785d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.266808:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:0.0:1784583995.266825:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30376e800 for lustre-MDT0001 00000020:00080000:0.0:1784583995.266838:0:15398:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302719000): rc 0 00000020:00000080:0.0:1784583995.266840:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b302719000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1784583995.266850:0:15398:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb9d4191bae0 00000020:00000080:0.0:1784583995.266860:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302719000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1784583995.266891:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30271d000 for lustre-MDT0001 00000100:00080000:0.0:1784583995.266910:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784583995.266913:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1784583995.267761:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1784583995.267773:0:15398:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784583995.267779:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b43ca61800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1784583995.267818:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784583995.267855:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599172736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583995.267915:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583995.267923:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583995.267930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784583995.267938:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b442046a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784583995.267942:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583995.267952:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784583995.267960:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784583995.267965:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784583995.267967:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784583995.267970:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1784583995.267995:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599172864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583995.267996:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583995.268006:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784583995.268017:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583995.268024:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b442046a00/0xdab2421a42e4753f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47546 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784583995.268025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583995.268049:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1784583995.268055:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784583995.268057:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599172992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784583995.268059:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583995.268061:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583995.268067:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583995.268070:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583995.268090:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583995.268094:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172736 00000100:00100000:0.0:1784583995.268096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583995.268102:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172736 00010000:00010000:1.0:1784583995.268106:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1cc00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784583995.268111:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.268120:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784583995.268128:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583995.268131:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172864 00000100:00100000:3.0:1784583995.268135:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172864 10000000:01000000:1.0:1784583995.268137:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784583995.268142:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784583995.268145:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1784583995.268149:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599172992 00000100:00100000:3.0:1784583995.268152:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599172992 00010000:00010000:1.0:1784583995.268166:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583995.268167:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1784583995.268177:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784583995.268178:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1871271599172736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784583995.268188:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784583995 with bad export cookie 15758730726681637948 00010000:00010000:1.0:1784583995.268204:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784583995.268213:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e47be4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e47beb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784583995.268232:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1871271599172736:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (302us total) trans 0 rc -107/-107 00010000:00010000:1.0:1784583995.268238:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583995.268242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1784583995.268243:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784583995.268248:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784583995.268255:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784583995.268262:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784583995.268268:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599173120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583995.268270:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1871271599172864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784583995.268279:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784583995 with bad export cookie 15758730726681637948 00000100:00100000:1.0:1784583995.268313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784583995.268324:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1871271599172864:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (299us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784583995.268333:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784583995.268345:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599173120 00000100:00100000:3.0:1784583995.268348:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599173120 00000100:00100000:3.0:1784583995.268358:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583995.268362:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1871271599172992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784583995.268375:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784583995 with bad export cookie 15758730726681637948 00000100:00100000:3.0:1784583995.268402:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1871271599172992:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (309us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784583995.268407:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784583995.268420:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784583995.268424:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1871271599173120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784583995.268429:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784583995 with bad export cookie 15758730726681637948 00000100:00100000:3.0:1784583995.268461:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1871271599173120:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (149us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784583995.268488:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1784583995.268572:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784583995.268576:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784583995.268580:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784583995.269122:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784583995.270123:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1784583995.273696:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1871271599172608:12345-0@lo:103:ldlm_bl.0 Request processed in 7879us (7982us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784583995.273708:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1784583995.275675:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784583995.275690:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1784583995.275705:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784583995.275767:0:15398:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784583995.275793:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b302458000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784583995.275809:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784583995.275811:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1784583995.275832:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784583995.275900:0:15398:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784583995.275910:0:15398:0:(import.c:65:import_set_state_nolock()) ffff98b302bd4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784583995.275933:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98b4331ab380) has no exports 00000100:00080000:3.0:1784583995.306024:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784583995.306030:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784583995.306040:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b30499b100 x1871271599171328/t0(0) o400->MGC192.168.203.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784584008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583995.306129:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b409219500 x1871271599172608/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584011 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583995.306141:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303963b80 x1871271599172736/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584011 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583995.306149:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303961500 x1871271599172864/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584011 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583995.306156:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b3048a6d80 x1871271599172992/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584011 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583995.306163:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303961180 x1871271599173120/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584011 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784583995.306280:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784583995.306288:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784583995.306290:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784583995.306377:0:3642:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98b41e60e000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1784583995.306386:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98b41e60e000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1784583995.306401:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48a91d92-bcef-47e2-812f-ada1e5d741c7:3642:1871271599173120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784583995.306416:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599173248:0@lo:9:umount.0 00000100:00100000:0.0:1784583995.306787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784583995.306951:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599173376:0@lo:9:umount.0 00000100:00100000:0.0:1784583995.307149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784583995.307423:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599173248 00000100:00100000:2.0:1784583995.307430:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599173248 00000100:00100000:1.0:1784583995.307459:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599172608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784583995.307499:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48a91d92-bcef-47e2-812f-ada1e5d741c7:3641:1871271599172736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583995.307508:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599173376 00000100:00100000:2.0:1784583995.307513:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599173376 00000100:00100000:2.0:1784583995.307543:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784583995.307551:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1871271599173248:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784583995.307577:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47745 00000100:00080000:2.0:1784583995.307584:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b302435000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583995.307621:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784583995.307748:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1871271599173248:12345-0@lo:9:umount.0 Request processed in 197us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583995.307755:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784583995.307768:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784583995.307774:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1871271599173376:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784583995.307784:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47895 00000100:00080000:2.0:1784583995.307788:0:8426:0:(import.c:65:import_set_state_nolock()) ffff98b302719800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784583995.307820:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1784583995.307861:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784583995.307867:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 186 00000100:00080000:3.0:1784583995.307884:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b41e60e000 using connection 192.168.203.151@tcp/0@lo 00010000:00010000:3.0:1784583995.307911:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784583995.307926:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784583995.307980:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a5180 x1871271599173504/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583995.308124:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599172864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784583995.308134:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599171328:0@lo:400:kworker.0 00000100:00100000:3.0:1784583995.308151:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48a91d92-bcef-47e2-812f-ada1e5d741c7:3639:1871271599172992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784583995.308400:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1871271599173376:12345-0@lo:9:umount.0 Request processed in 625us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784583995.308408:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1784583995.308510:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784583995.308515:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784583995.308549:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599173504:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1784583995.308616:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599173504 offset 0 length 520: 4 00000100:00080000:0.0:1784583995.308655:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302458000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784583995.308705:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784583995.308769:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.308773:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599173248:0@lo:9:umount.0 00000100:00080000:0.0:1784583995.308787:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784583995.308812:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784583995.308814:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.308817:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599173376:0@lo:9:umount.0 00000020:00080000:3.0:1784583995.318780:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98b4331ab380) has no exports 00000020:01000000:2.0:1784583995.375854:0:15398:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b303929cc0 - data ffff98b41defa000/ffff98b30383a000 00000020:01000000:2.0:1784583995.376270:0:15398:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b43e756c60 - data ffff98b41dc1aca8/ffff98b43e825400 00000001:00000004:0.0:1784583995.403605:0:15398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1784583995.448965:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784583995.448974:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1784583995.448982:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784583995.453084:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784583995.453092:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1784583995.453111:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.453113:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784583995.455782:0:8789:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784583995.455789:0:8789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1784583995.455803:0:8789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784583995.456596:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784583995.456603:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1784583995.456616:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.456630:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784583995.459053:0:9976:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784583995.459059:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1784583995.459071:0:9976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1784583995.461183:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47562 00000020:00000080:0.0:1784583995.461196:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b4049c6800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784583995.463051:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47577 00000020:00000080:0.0:1784583995.463062:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43c89e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.463117:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049c6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784583995.463183:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1784583995.463188:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.463195:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784583995.463199:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98b4331a8000) has no exports 00000004:01000000:0.0:1784583995.463357:0:15398:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784583995.463365:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47880 00000020:00000080:0.0:1784583995.463369:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b302b0e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.463461:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43c89e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784583995.463697:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784583995.463701:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.463708:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784583995.463711:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98b302a4cd40) has no exports 00000020:00000080:0.0:1784583995.463716:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47879 00000020:00000080:0.0:1784583995.463720:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b302bd6000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784583995.463742:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1784583995.464189:0:15398:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784583995.464194:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784583995.464198:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1784583995.464204:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.464206:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784583995.464299:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784583995.464380:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.464388:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784583995.464395:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4773e 00000020:00000080:0.0:1784583995.464399:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b3029ab000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.464417:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302bd4000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1784583995.464422:0:36:0:(genops.c:906:class_export_put()) final put ffff98b30376b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.464424:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1784583995.464429:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784583995.464894:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784583995.464899:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.464904:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784583995.464907:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98b43ea63380) has no exports 00000020:00000080:0.0:1784583995.464912:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47737 00000020:00000080:0.0:1784583995.464916:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b404997000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784583995.464946:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3029ab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1784583995.465422:0:15398:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784583995.465426:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784583995.465429:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1784583995.465432:0:15398:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784583995.465434:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784583995.465458:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b404997000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784583995.465603:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.465610:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1784583995.465623:0:15398:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784583995.465628:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4759a 00000020:00000080:0.0:1784583995.465633:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b4049c0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.465655:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302458000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1784583995.465661:0:36:0:(genops.c:906:class_export_put()) final put ffff98b30271e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.465663:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30271e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1784583995.465667:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784583995.465741:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1784583995.465745:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.465749:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784583995.465752:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98b42e9319c0) has no exports 00000020:00000080:0.0:1784583995.465756:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47593 00000020:00000080:0.0:1784583995.465760:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b4049c6000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784583995.466301:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049c0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784583995.466309:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049c6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784583995.473801:0:15398:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1784583995.473810:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784583995.473815:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1784583995.473824:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784583995.473921:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.473932:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784583995.473971:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.473975:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784583995.473981:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43ca66800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784583995.473986:0:15398:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca66800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784583995.473997:0:15398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784583995.474178:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4757e 00000020:00000080:0.0:1784583995.474186:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43cb01800/lustre-MDD0001_UUID 00000020:00000080:3.0:1784583995.474278:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca61800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784583995.474284:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43c899000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784583995.474286:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43c899000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1784583995.474290:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784583995.474643:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1784583995.474648:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.474677:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784583995.474681:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98b42e934d40) has no exports 00000020:00000080:0.0:1784583995.474723:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.474727:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1784583995.474732:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47585 00000020:00000080:0.0:1784583995.474746:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43cb00800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784583995.474780:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb01800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1784583995.474785:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43ca64000/lustre-MDD0001_UUID 00000020:00000080:3.0:1784583995.474787:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca64000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1784583995.474790:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1784583995.475019:0:15398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b42ba2f000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1784583995.475024:0:15398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b42ba2f000 2 00000020:01000004:0.0:1784583995.475027:0:15398:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b42ba2f000 from lustre-MDT0001 00000020:00000080:0.0:1784583995.475049:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.475053:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1784583995.475055:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b4049c7800/lustre-MDT0001_UUID 00000020:00000080:0.0:1784583995.475058:0:15398:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049c7800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1784583995.475064:0:15398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1784583995.475097:0:15398:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1784583995.475101:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1784583995.475103:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.475107:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784583995.475113:0:15398:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98b43e710000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784583995.475117:0:15398:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff98b42e930000) has exports, disconnecting them 00000020:00080000:0.0:1784583995.475121:0:15398:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98b43e710000), last request at 1784583762 00000020:00000080:0.0:1784583995.475124:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e475d9 00000020:00080000:0.0:1784583995.475135:0:15398:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b43e710000): rc 0 00000020:00000080:0.0:1784583995.475138:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43e710000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784583995.475162:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb00800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784583995.476017:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e710000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1784583995.482540:0:15398:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1784583995.482547:0:15398:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784583995.482551:0:15398:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784583995.482559:0:15398:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784583995.482714:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784583995.482724:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1784583995.482733:0:15398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b42ba2f000 1 00000020:00000080:2.0:1784583995.482740:0:15398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47515 00000020:00000080:2.0:1784583995.482748:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b43ca6f800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1784583995.482754:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1784583995.482758:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784583995.482762:0:15398:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784583995.482766:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98b4049db380) has no exports 00000020:00000080:3.0:1784583995.485027:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43e717000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784583995.485039:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43e712000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1784583995.485042:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e712000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1784583995.485053:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1784583995.485113:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca6f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:2.0:1784583995.637116:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784583995.657714:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784583995.657729:0:15398:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1784583995.657734:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b4049d7800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784583995.657739:0:15398:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784583995.657751:0:15398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1784583995.657889:0:15398:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b42ba2c800 00000020:01000000:0.0:1784583995.657908:0:15398:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784583995.657921:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784583995.657926:0:15398:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784583995.657930:0:15398:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98b4331e3380) has no exports 00000100:00100000:1.0:1784583995.658148:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98b417882800:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1784583995.658239:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98b40a269a00:6516] 2 exiting: rc = 0 00000100:00100000:2.0:1784583995.662135:0:9809:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98b30270a200:9809] 3 exiting: rc = 0 00000100:00100000:2.0:1784583995.662287:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98b40a268e00:6515] 1 exiting: rc = 0 00000100:00100000:1.0:1784583995.662385:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662395:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662401:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662407:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662413:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662418:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662423:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662428:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662434:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662439:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662445:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662451:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662500:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662506:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662511:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662519:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662525:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662530:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662537:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662542:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662547:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662552:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662557:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662563:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662568:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662572:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662577:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662582:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662586:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662591:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662596:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662602:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662606:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662612:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662617:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662623:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662629:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662634:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662640:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662646:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662652:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662657:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662662:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662668:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662673:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662678:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662695:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662710:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662715:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662720:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662726:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662732:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662738:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662743:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662748:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662753:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662759:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662764:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662768:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662773:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662779:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662784:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662789:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.662794:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.665052:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98b420d4ae00:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1784583995.665239:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98b40a269c00:6517] 0 exiting: rc = 1 00000100:00100000:1.0:1784583995.669200:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669212:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669219:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669225:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669231:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669236:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669243:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669249:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669254:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669259:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669265:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669272:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669279:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669284:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669288:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669293:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669298:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669302:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669325:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669331:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669337:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669342:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669347:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669353:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669357:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669362:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669368:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669373:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669378:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669382:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669387:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669392:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669397:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669402:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669407:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669413:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669418:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669423:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669428:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669433:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669438:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669442:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669447:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669452:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669456:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.669462:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670803:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670837:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670843:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670848:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670854:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670859:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670865:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670896:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670902:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670907:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670914:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670920:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670925:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670930:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670935:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670940:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670946:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.670951:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.672215:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98b417883800:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1784583995.673635:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98b417883e00:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1784583995.674159:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674182:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674191:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674196:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674202:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674208:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674214:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674219:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674225:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674231:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674246:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674253:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674259:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674265:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674271:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674277:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674283:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674289:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674295:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674300:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674306:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674311:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674331:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674338:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674344:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674349:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674354:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674360:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674366:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674372:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674393:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674398:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674403:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674408:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674425:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674431:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674437:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674442:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674448:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674454:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674459:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674464:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674499:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674506:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674511:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674516:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674535:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674542:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674547:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674553:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674558:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674564:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674569:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674575:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674581:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674587:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674593:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674599:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674619:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674628:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674633:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674639:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674645:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.674659:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784583995.706422:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98b4172b5400:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1784583995.706951:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98b42c70a400:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1784583995.707220:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707228:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707234:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707239:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707245:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707249:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707254:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707259:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707264:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707270:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707275:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707280:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707286:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707292:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707298:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707303:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707309:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707314:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707319:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707324:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707330:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707335:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707340:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707346:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707360:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707365:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707370:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707376:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707380:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707385:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707391:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707396:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707400:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707405:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707410:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707415:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707419:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707424:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707428:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707434:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707440:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707445:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707449:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707455:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707460:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707573:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707581:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707585:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707589:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707594:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707600:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707605:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707610:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707615:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707620:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707626:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707631:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707636:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707641:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707654:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707659:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707664:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707669:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.707674:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.709512:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98b42c70b600:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1784583995.710641:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98b42c706c00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1784583995.710759:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710767:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710771:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710776:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710792:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710798:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710804:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710822:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710827:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710833:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710838:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710844:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710850:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710856:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710862:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710877:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710883:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710890:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710895:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710901:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710906:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710911:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710916:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710922:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710928:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710933:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710939:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710945:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710951:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710956:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710962:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710968:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710973:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710979:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710984:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710990:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.710996:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711001:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711008:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711021:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711026:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711030:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711035:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711040:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711045:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711049:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711054:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711059:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711064:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711069:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711075:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711079:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711084:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711089:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711093:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711098:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711103:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711108:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711113:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711119:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711124:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711129:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711133:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711139:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.711562:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98b42c706800:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1784583995.711732:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98b42c702600:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1784583995.712059:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712066:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712071:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712076:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712081:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712086:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712092:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712097:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712102:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712118:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712124:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712129:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712134:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712139:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712145:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712150:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712156:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712161:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712165:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712169:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712174:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712178:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712184:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712188:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712193:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712197:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712201:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712206:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712211:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712216:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712221:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712226:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712232:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712237:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712242:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712247:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712251:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712256:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712261:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712265:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712270:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712275:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712281:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712286:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712300:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712305:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712310:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712316:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712321:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712327:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712332:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712337:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712341:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712346:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712352:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712357:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712361:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712366:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712370:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712375:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712380:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712384:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712389:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784583995.712394:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.713024:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98b4172e8a00:6527] 0 exiting: rc = 1 00000100:00100000:3.0:1784583995.713186:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98b42c703600:6529] 2 exiting: rc = 0 00000100:00100000:3.0:1784583995.713368:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98b4172e9400:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1784583995.720129:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720140:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720147:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720152:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720158:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720164:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720170:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720175:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720181:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720212:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720219:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720224:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720229:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720234:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720239:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720244:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720250:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720255:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720261:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720266:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720271:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720277:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720282:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720287:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720294:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720299:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720305:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720322:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720328:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720334:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720340:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720345:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720351:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720372:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720379:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720384:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720390:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720396:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720403:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720408:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720413:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720420:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720426:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720431:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720436:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720441:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720447:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720452:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720457:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720463:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720495:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720501:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720506:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720513:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720518:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720524:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720529:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720550:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720557:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720563:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720569:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720574:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720588:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784583995.720593:0:15398:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784583995.737162:0:15398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784583995.737185:0:15398:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784583995.737190:0:15398:0:(genops.c:906:class_export_put()) final put ffff98b416bdc000/MDS_uuid 00000020:00000080:1.0:1784583995.737194:0:15398:0:(genops.c:865:class_export_destroy()) destroying export ffff98b416bdc000/MDS_uuid for MDS 00000020:01000000:1.0:1784583995.737202:0:15398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784583995.737350:0:15398:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1784583996.657303:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784583997.618239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784583997.618251:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784583997.618254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784583997.618257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784583997.618261:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784583997.618270:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1784583997.618276:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784583997.618283:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b30271c000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583997.618330:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303963480 x1871271599173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784583997.618388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784583997.618393:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784583997.618395:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784583997.618398:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1784583997.618401:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784583997.618405:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b30376b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784583997.618417:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303962a00 x1871271599173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784583997.618441:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599173760:0@lo:400:kworker.0 00000400:00000100:3.0:1784583997.618525:0:3642:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599173760 offset 0 length 224: 4 00000100:00100000:1.0:1784583997.618541:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784583997.618565:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599174016:0@lo:400:kworker.0 00000400:00000100:1.0:1784583997.618593:0:3640:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174016 offset 0 length 224: 4 00000100:00100000:2.0:1784583997.618636:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599173632:0@lo:38:kworker.0 00000400:00000100:2.0:1784583997.618661:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599173632 offset 0 length 520: 4 00000100:00100000:2.0:1784583997.618680:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599173888:0@lo:38:kworker.0 00000400:00000100:2.0:1784583997.618695:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599173888 offset 0 length 520: 4 00010000:00010000:3.0:1784583997.677752:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784583998.701716:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784583999.012660:0:15599:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784583999.025762:0:15599:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784583999.025821:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583999.025838:0:15599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583999.025872:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583999.025879:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784583999.025906:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784583999.025911:0:15599:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784583999.025935:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784583999.025946:0:15599:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303963480 x1871271599173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583999.025962:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784583999.025968:0:15599:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784583999.025973:0:15599:0:(import.c:65:import_set_state_nolock()) ffff98b30271c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784583999.025978:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784583999.025981:0:15599:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303963480 x1871271599173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584017 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583999.025988:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784583999.025992:0:15599:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1784583999.026086:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599173632:0@lo:38:kworker.0 00010000:00010000:0.0:1784583999.026500:0:15399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784583999.026508:0:15399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583999.026517:0:15399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784583999.026520:0:15399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583999.026531:0:15399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784583999.026537:0:15399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784583999.026542:0:15399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784583999.026545:0:15399:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784583999.026547:0:15399:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784583999.026572:0:15399:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:0.0:1784583999.026577:0:15399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583999.026584:0:15399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e47952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47959 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784583999.026597:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583999.026599:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784583999.026600:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784583999.027332:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784583999.027345:0:15599:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303960a80 x1871271599173760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784583999.027369:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784583999.027374:0:15599:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784583999.027397:0:15599:0:(import.c:65:import_set_state_nolock()) ffff98b30271b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784583999.027645:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599173760:0@lo:400:kworker.0 00000100:00100000:2.0:1784583999.027681:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599174144:0@lo:39:umount.0 00000400:00000100:2.0:1784583999.027732:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174144 offset 0 length 224: 4 00010000:00010000:3.0:1784583999.726746:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584000.621974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584000.621983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584000.621985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584000.622004:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584000.622120:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584000.622141:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599174272:0@lo:400:kworker.0 00000400:00000100:1.0:1784584000.622189:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174272 offset 0 length 224: 4 00000001:00100000:2.0:1784584000.686776:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784584000.686784:0:9507:0:(genops.c:906:class_export_put()) final put ffff98b302718800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1784584000.686802:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784584000.686805:0:8422:0:(genops.c:906:class_export_put()) final put ffff98b302437800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784584000.686886:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302718800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784584000.686982:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302437800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784584000.687091:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302719800 for lustre-OST0001 00000020:00000080:0.0:1784584000.687096:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302435000 for lustre-OST0000 00010000:00010000:2.0:1784584000.749757:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584001.774013:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584002.670834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584002.670844:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584002.670846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584002.670849:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584002.671025:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584002.671048:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599174400:0@lo:400:kworker.0 00000400:00000100:3.0:1784584002.671102:0:3642:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174400 offset 0 length 224: 4 00010000:00010000:3.0:1784584002.797803:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584003.823949:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584004.847111:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584005.165757:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784583995/real 1784583995] req@ffff98b3048a5180 x1871271599173504/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584005.165786:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a5180 x1871271599173504/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584005.165819:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584005.165843:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784584005.165848:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599173504:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1784584005.165888:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584005.165895:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784584005.165898:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584005.165904:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1784584005.165908:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584005.165914:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b41e60e000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584005.165943:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b40921bb80 x1871271599174528/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584005.165965:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584005.165969:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584005.166242:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599174528:0@lo:250:kworker.0 00000400:00000100:0.0:1784584005.166286:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599174528 offset 0 length 520: 4 00000100:00100000:3.0:1784584005.166566:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599174656:0@lo:400:kworker.0 00000400:00000100:3.0:1784584005.166595:0:3642:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174656 offset 0 length 224: 4 00010000:00010000:3.0:1784584005.869656:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584006.893682:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584007.917670:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584008.941693:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584009.261928:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784583999/real 1784583999] req@ffff98b3048a6d80 x1871271599174144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584009.261983:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a6d80 x1871271599174144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584009.262002:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30271b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784584009.262024:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599174144:0@lo:39:umount.0 00000100:00080000:3.0:1784584009.262314:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784584009.262319:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784584009.262323:0:15599:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784584009.266668:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266689:0:15599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266697:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266703:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266735:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584009.266743:0:15599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266770:0:15599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266777:0:15599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584009.266795:0:15599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.266806:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584009.266816:0:15599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784584009.266897:0:15599:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1784584009.267023:0:15599:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1784584009.267028:0:15599:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1784584009.267033:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584009.267038:0:15599:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784584009.267042:0:15599:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98b30247cd40) has no exports 00000020:00080000:3.0:1784584009.267064:0:15599:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98b30247cd40) has no exports 00010000:00010000:1.0:1784584009.270453:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270488:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584009.270493:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270503:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584009.270512:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584009.270519:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584009.270521:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784584009.270525:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1784584009.270545:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:1.0:1784584009.270550:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270579:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982800/0xdab2421a42e47960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47967 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270595:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584009.270599:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270605:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584009.270608:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270615:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584009.270621:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584009.270626:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784584009.270628:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784584009.270631:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784584009.270637:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:1.0:1784584009.270640:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270645:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97600/0xdab2421a42e47bd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47bdd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584009.270653:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584009.270655:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584009.270664:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784584009.271198:0:15599:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b303929300 - data ffff98b41de2be58/ffff98b30383b800 00000020:01000000:3.0:1784584009.271948:0:15599:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b302672ea0 - data ffff98b41de2c6c0/ffff98b302adb000 00010000:00010000:0.0:1784584009.272897:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784584009.282888:0:15599:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784584009.291745:0:15599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e476b2 00000020:00000080:3.0:1784584009.291758:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b302435800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1784584009.291833:0:15599:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b43e967000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1784584009.291837:0:15599:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b43e967000 2 00000020:01000004:3.0:1784584009.291841:0:15599:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b43e967000 from lustre-OST0000 00000020:00000080:3.0:1784584009.291866:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584009.291878:0:15599:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784584009.291881:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b302430000/lustre-OST0000_UUID 00000020:00000080:3.0:1784584009.291883:0:15599:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302430000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1784584009.291897:0:15599:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1784584009.291968:0:15599:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784584009.291973:0:15599:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784584009.291976:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584009.291984:0:15599:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784584009.291991:0:15599:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98b302718000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784584009.291996:0:15599:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff98b43ea619c0) has exports, disconnecting them 00000020:00080000:3.0:1784584009.292001:0:15599:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98b302718000), last request at 1784583781 00000020:00000080:3.0:1784584009.292005:0:15599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e476dc 00000020:00080000:3.0:1784584009.292015:0:15599:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302718000): rc 0 00000020:00000080:3.0:1784584009.292019:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b302718000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784584009.292144:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302435800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784584009.295399:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302718000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784584009.295457:0:15599:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784584009.295462:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584009.295479:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584009.295486:0:15599:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584009.295511:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30271c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784584009.295716:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584009.295725:0:15599:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784584009.295730:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b30245c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784584009.295732:0:15599:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30245c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784584009.295737:0:15599:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1784584009.295817:0:15599:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784584009.295822:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584009.295827:0:15599:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784584009.295833:0:15599:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98b30271d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584009.295839:0:15599:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff98b43ea60000) has exports, disconnecting them 00000020:00080000:0.0:1784584009.295844:0:15599:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98b30271d800), last request at 1784583781 00000020:00000080:0.0:1784584009.295849:0:15599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e476f1 00000020:00080000:0.0:1784584009.295861:0:15599:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b30271d800): rc 0 00000020:00000080:0.0:1784584009.295878:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b30271d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784584009.302056:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30271d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1784584009.302640:0:15599:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784584009.302645:0:15599:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784584009.302649:0:15599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784584009.302655:0:15599:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784584009.302682:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30271b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784584009.302833:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584009.302841:0:15599:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1784584009.302846:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b30271f000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1784584009.302849:0:15599:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30271f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1784584009.302854:0:15599:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1784584009.302922:0:15599:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b43e967000 1 00000020:00000080:3.0:1784584009.302927:0:15599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4767a 00000020:00000080:3.0:1784584009.302933:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b43e712800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1784584009.302942:0:15599:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1784584009.302953:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e712800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784584009.302965:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584009.302970:0:15599:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784584009.302982:0:15599:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff98b43ea64d40) has no exports 00000020:00000080:3.0:1784584009.327818:0:15599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584009.327832:0:15599:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1784584009.327837:0:15599:0:(genops.c:906:class_export_put()) final put ffff98b43e960000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1784584009.327842:0:15599:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e960000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1784584009.327850:0:15599:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1784584009.327952:0:15599:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b43e965000 00000020:02000400:3.0:1784584009.327990:0:15599:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784584009.965666:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784584010.414751:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784584010.414762:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584010.414765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784584010.414768:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584010.415801:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584010.415823:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599174784:0@lo:400:kworker.0 00000400:00000100:2.0:1784584010.415872:0:3640:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174784 offset 0 length 224: 4 00010000:00010000:1.0:1784584010.990643:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584012.014910:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784584012.807261:0:15801:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784584012.821636:0:15801:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1784584012.821716:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584012.821730:0:15801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584012.821754:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584012.821772:0:15801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584012.821788:0:15801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784584012.821793:0:15801:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784584012.821821:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784584012.821833:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303962a00 x1871271599173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.821948:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784584012.821955:0:15801:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784584012.821960:0:15801:0:(import.c:65:import_set_state_nolock()) ffff98b30376b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1784584012.821965:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784584012.821969:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303962a00 x1871271599173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584017 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784584012.822692:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584012.822701:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584012.822710:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584012.822714:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584012.822723:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584012.822730:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584012.822735:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784584012.822738:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784584012.822741:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784584012.822754:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:0.0:1784584012.822766:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584012.822774:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97a00/0xdab2421a42e47936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e4793d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584012.822784:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584012.822786:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584012.822788:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584012.822996:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784584012.823024:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599173888:0@lo:38:kworker.0 00000100:00100000:2.0:1784584012.823261:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784584012.827052:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584012.827070:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303962680 x1871271599174016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.827137:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b43ef1b800 x1871271599174272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.827157:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b43ef1a300 x1871271599174400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.827175:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b409219180 x1871271599174656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.827196:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b303960a80 x1871271599174784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584012.827203:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784584012.827208:0:15801:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784584012.827232:0:15801:0:(import.c:65:import_set_state_nolock()) ffff98b404995800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784584012.827299:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599174272:0@lo:400:kworker.0 00000100:00100000:1.0:1784584012.827369:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599174656:0@lo:400:kworker.0 00000100:00100000:1.0:1784584012.827376:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599174400:0@lo:400:kworker.0 00000100:00100000:1.0:1784584012.827406:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599174912:0@lo:39:umount.0 00000400:00000100:1.0:1784584012.827689:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599174912 offset 0 length 224: 4 00000100:00100000:3.0:1784584012.828069:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599174016:0@lo:400:kworker.0 00000100:00100000:3.0:1784584012.828083:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599174784:0@lo:400:kworker.0 00010000:00010000:1.0:1784584013.038946:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584014.062181:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584015.087229:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584015.533722:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584015.533733:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784584016.110607:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584017.136070:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584018.157720:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584019.181715:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584020.015743:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584005/real 1784584005] req@ffff98b40921bb80 x1871271599174528/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584020.015780:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b40921bb80 x1871271599174528/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584020.015801:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584020.015836:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784584020.015840:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599174528:0@lo:250:kworker.0 00000100:00080000:2.0:1784584020.015938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584020.015943:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784584020.015946:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584020.015951:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 448 00000100:00080000:2.0:1784584020.015956:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584020.015964:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b41e60e000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584020.015996:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b409218a80 x1871271599175040/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584020.016609:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599175040:0@lo:250:kworker.0 00000400:00000100:1.0:1784584020.016656:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599175040 offset 0 length 520: 4 00010000:00010000:0.0:1784584020.205659:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584021.230924:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584022.061595:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584012/real 1784584012] req@ffff98b40921b480 x1871271599174912/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584022.061627:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b40921b480 x1871271599174912/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584022.061645:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b404995800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784584022.061668:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599174912:0@lo:39:umount.0 00000100:00080000:2.0:1784584022.061858:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584022.061862:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784584022.061867:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784584022.063233:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063250:0:15801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063258:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063284:0:15801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063319:0:15801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584022.063327:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063334:0:15801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063339:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063345:0:15801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584022.063449:0:15801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1784584022.063455:0:15801:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1784584022.063502:0:15801:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1784584022.063506:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1784584022.063511:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584022.063516:0:15801:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784584022.063520:0:15801:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff98b4049dcd40) has no exports 00000020:00080000:2.0:1784584022.063541:0:15801:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff98b4049dcd40) has no exports 00000020:01000000:2.0:1784584022.065362:0:15801:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b302b675a0 - data ffff98b41df321b0/ffff98b303761400 00000020:01000000:2.0:1784584022.067681:0:15801:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b303929900 - data ffff98b41df28ca8/ffff98b43ed1f400 00010000:00010000:0.0:1784584022.068155:0:15399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584022.068166:0:15399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068436:0:15399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1da00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584022.068441:0:15399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068453:0:15399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584022.068461:0:15399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584022.068479:0:15399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784584022.068482:0:15399:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784584022.068485:0:15399:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784584022.068503:0:15399:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:0.0:1784584022.068507:0:15399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068514:0:15399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e47944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e4794b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068526:0:15399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584022.068544:0:15399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068551:0:15399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ce00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584022.068554:0:15399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068560:0:15399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584022.068566:0:15399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584022.068571:0:15399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784584022.068573:0:15399:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784584022.068575:0:15399:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784584022.068581:0:15399:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:0.0:1784584022.068584:0:15399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068591:0:15399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e47bc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47bcf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584022.068603:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584022.068605:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584022.068607:0:15399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584022.070254:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1784584022.092204:0:15801:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784584022.108901:0:15801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e477d8 00000020:00000080:1.0:1784584022.108913:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b43ed10800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1784584022.109082:0:15801:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b30245a800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1784584022.109087:0:15801:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b30245a800 2 00000020:01000004:1.0:1784584022.109090:0:15801:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b30245a800 from lustre-OST0001 00000020:00000080:1.0:1784584022.109114:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584022.109124:0:15801:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1784584022.109127:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b43ed17800/lustre-OST0001_UUID 00000020:00000080:1.0:1784584022.109130:0:15801:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed17800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1784584022.109141:0:15801:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1784584022.109278:0:15801:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 48a91d92-bcef-47e2-812f-ada1e5d741c7->MGS 00010000:00010000:1.0:1784584022.109292:0:15801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b442046600/0xdab2421a42e47531 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584022.109315:0:15801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b442046600/0xdab2421a42e47531 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584022.109321:0:15801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1784584022.109324:0:15801:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1784584022.109327:0:15801:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1784584022.109340:0:15801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:1.0:1784584022.109344:0:15801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b442046600/0xdab2421a42e47531 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e47538 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584022.109369:0:15801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584022.109376:0:15801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584022.109381:0:15801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584022.109383:0:15801:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1784584022.109385:0:15801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1784584022.109394:0:15801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b41e60e000 00010000:00010000:1.0:1784584022.109396:0:15801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e479a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e479ad expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784584022.109411:0:15801:0:(import.c:65:import_set_state_nolock()) ffff98b41e60e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1784584022.109415:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784584022.109417:0:15801:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784584022.109418:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784584022.109422:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784584022.109433:0:15801:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b409218a80 x1871271599175040/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784584040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784584022.109456:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784584022.109459:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1784584022.109529:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48a91d92-bcef-47e2-812f-ada1e5d741c7:3638:1871271599175040:0@lo:250:kworker.0 10000000:01000000:1.0:1784584022.109792:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1784584022.109800:0:15801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e4742e 00000020:00000080:1.0:1784584022.109805:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b416bdd000/48a91d92-bcef-47e2-812f-ada1e5d741c7 00000020:00000080:2.0:1784584022.110553:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed10800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784584022.113752:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.151@tcp (flags='') 00000020:00000080:1.0:1784584022.113765:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584022.113775:0:15801:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784584022.113780:0:15801:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98b4331acd40) has no exports 10000000:01000000:0.0:1784584022.114350:0:6510:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1784584022.114578:0:15801:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.151@tcp: client import never connected 00000100:00080000:1.0:1784584022.114596:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1784584022.114599:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784584022.114603:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1784584022.114605:0:15801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784584022.114665:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b416bdd000/48a91d92-bcef-47e2-812f-ada1e5d741c7 for MGC192.168.203.151@tcp 00000020:00000080:1.0:1784584022.121362:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584022.121388:0:15801:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.151@tcp (uuid 48a91d92-bcef-47e2-812f-ada1e5d741c7) 00000020:01000000:1.0:1784584022.121397:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1784584022.121404:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584022.121409:0:15801:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784584022.121416:0:15801:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98b303768800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784584022.121422:0:15801:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff98b302a4b380) has exports, disconnecting them 00000020:00080000:1.0:1784584022.121427:0:15801:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98b303768800), last request at 1784583800 00000020:00000080:1.0:1784584022.121431:0:15801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47802 00000020:00080000:1.0:1784584022.121445:0:15801:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b303768800): rc 0 00000020:00000080:1.0:1784584022.121449:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b303768800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784584022.127023:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b41e60e000 for MGC192.168.203.151@tcp 00000020:00000080:2.0:1784584022.127041:0:36:0:(genops.c:906:class_export_put()) final put ffff98b41e608800/48a91d92-bcef-47e2-812f-ada1e5d741c7 00000020:00000080:2.0:1784584022.127051:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e608800/48a91d92-bcef-47e2-812f-ada1e5d741c7 for MGC192.168.203.151@tcp 00000020:01000000:2.0:1784584022.127061:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.151@tcp (48a91d92-bcef-47e2-812f-ada1e5d741c7) 00000020:00000080:2.0:1784584022.130332:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b303768800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1784584022.131689:0:15801:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784584022.131696:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584022.131720:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584022.131727:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584022.131867:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584022.131876:0:15801:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1784584022.131882:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784584022.131886:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584022.131890:0:15801:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784584022.131898:0:15801:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98b3029ad000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584022.131905:0:15801:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff98b4071a8000) has exports, disconnecting them 00000020:00080000:0.0:1784584022.131909:0:15801:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98b3029ad000), last request at 1784583800 00000020:00000080:0.0:1784584022.131913:0:15801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e47817 00000020:00080000:0.0:1784584022.131938:0:15801:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b3029ad000): rc 0 00000020:00000080:0.0:1784584022.131944:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b3029ad000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1784584022.132731:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30376b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784584022.132741:0:36:0:(genops.c:906:class_export_put()) final put ffff98b302bd3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1784584022.132744:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1784584022.132750:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1784584022.132814:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3029ad000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1784584022.134630:0:15801:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784584022.134638:0:15801:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584022.134641:0:15801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784584022.134648:0:15801:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784584022.134682:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b404995800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1784584022.171631:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784584022.173108:0:15399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1784584022.173300:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1784584022.173669:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98b40a59fe00:6497] 0 exiting: rc = 1 00000100:00100000:2.0:1784584022.197641:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98b40a59f200:6498] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.197758:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.198004:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98b42c4d7600:6501] 2 exiting: rc = 0 00000100:00100000:2.0:1784584022.198052:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98b40a59e000:6499] 0 exiting: rc = 1 00000100:00100000:3.0:1784584022.213526:0:8443:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98b43ed2dc00:8443] 3 exiting: rc = 0 00000100:00100000:3.0:1784584022.213815:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98b42c4d6200:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.213957:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.213965:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.213970:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.213977:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.213983:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.213988:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214004:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214010:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214016:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214022:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214028:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214034:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214041:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214047:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214052:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214058:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214063:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214069:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214075:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214081:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214086:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214091:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214096:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214102:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214107:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214112:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214117:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214122:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214128:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214133:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214139:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214144:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214149:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214154:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214159:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214164:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214170:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214175:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214181:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214186:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214191:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214281:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214288:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214294:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214300:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214304:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214310:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214315:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214320:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214325:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214330:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214342:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214347:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214353:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214358:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214364:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214369:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214374:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214379:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214385:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214390:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214395:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214399:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.214405:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784584022.256115:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584022.256170:0:15801:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1784584022.256177:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b3029ac800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1784584022.256182:0:15801:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3029ac800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1784584022.256188:0:15801:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1784584022.256269:0:15801:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b30245a800 1 00000020:00000080:2.0:1784584022.256276:0:15801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e477a7 00000020:00000080:2.0:1784584022.256281:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b43ed14800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1784584022.256292:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1784584022.256296:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584022.256300:0:15801:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784584022.256312:0:15801:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff98b302a48000) has no exports 00000020:00000080:0.0:1784584022.257042:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed14800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1784584022.293948:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584022.293960:0:15801:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1784584022.293966:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b302bd7000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1784584022.293970:0:15801:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1784584022.293975:0:15801:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1784584022.294299:0:15801:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b30245b000 00000020:01000000:3.0:1784584022.294321:0:15801:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1784584022.294325:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584022.294329:0:15801:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784584022.294333:0:15801:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98b42e933380) has no exports 00000020:00000080:3.0:1784584022.294352:0:15801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584022.294356:0:15801:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1784584022.294359:0:15801:0:(genops.c:906:class_export_put()) final put ffff98b43e711000/OSS_uuid 00000020:00000080:3.0:1784584022.294361:0:15801:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e711000/OSS_uuid for OSS 00000020:01000000:3.0:1784584022.294365:0:15801:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1784584022.294508:0:6509:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1784584022.296656:0:8805:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98b3026a2e00:8805] 3 exiting: rc = 0 00000100:00100000:0.0:1784584022.296681:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98b43e6a1c00:8429] 2 exiting: rc = 0 00000100:00100000:1.0:1784584022.297351:0:11860:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98b43eaa0600:11860] 4 exiting: rc = 0 00000100:00100000:0.0:1784584022.297352:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98b43e6a0a00:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1784584022.297740:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98b43c9d9200:8426] 0 exiting: rc = 1 00000100:00100000:2.0:1784584022.297914:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297971:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297978:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297982:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297986:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297989:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297992:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297995:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.297999:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298002:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298005:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298008:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298011:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298014:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298017:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298020:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298023:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298026:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298029:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298032:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298035:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298038:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298041:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298171:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298174:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298179:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298242:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298250:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298255:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298259:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298264:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298269:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298274:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298279:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298299:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298304:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298308:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298313:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298317:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298323:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298328:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298333:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298338:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298344:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298348:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298352:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298355:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298359:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298363:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298366:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298369:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298372:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298376:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298381:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298386:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298391:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298395:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298400:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298462:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298494:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298500:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298505:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298510:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.298523:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584022.300437:0:10350:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98b30409a800:10350] 2 exiting: rc = 0 00000100:00100000:1.0:1784584022.300880:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98b43e841c00:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1784584022.300934:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98b42e8fd000:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.301114:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301287:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301295:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301301:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301306:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301320:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301326:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301330:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301335:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301340:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301345:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301350:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301361:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301368:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301373:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301378:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301383:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301388:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301394:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301400:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301537:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301544:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301549:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301554:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301559:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301564:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301569:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301574:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301579:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301584:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301589:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301594:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301600:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301605:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301610:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301615:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301620:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301625:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301630:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301635:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301648:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301653:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301658:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301663:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301668:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301674:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301679:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301685:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301690:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301694:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301710:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301715:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301720:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301725:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301729:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301735:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301741:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301746:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301751:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301755:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301893:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301899:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.301904:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.302666:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584022.309884:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98b43ca7c000:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1784584022.311377:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98b43ca7c400:8434] 2 exiting: rc = 0 00000100:00100000:1.0:1784584022.314893:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98b43ca7da00:8433] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.315027:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315037:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315110:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315120:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315250:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315256:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315262:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315267:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315273:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315286:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315305:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315310:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315316:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315322:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315328:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315334:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315339:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315345:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315350:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315356:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315362:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315367:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315372:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315377:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315382:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315388:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315394:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315399:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315404:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315409:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315415:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315420:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315425:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315446:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315454:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315459:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315485:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315494:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315500:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315505:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315511:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315517:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315521:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315526:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315531:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315545:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315550:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315556:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315562:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315568:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315573:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315578:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315591:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315598:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315604:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315616:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315624:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315630:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315636:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315641:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315647:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315653:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315659:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.315664:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584022.322717:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98b416b0f400:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1784584022.322803:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98b416b0e000:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.322934:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322944:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322950:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322955:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322960:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322964:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322969:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322974:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322979:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322985:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322990:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.322995:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323004:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323011:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323016:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323021:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323039:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323043:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323056:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323062:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323066:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323071:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323076:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323081:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323086:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323090:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323095:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323100:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323105:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323110:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323115:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323121:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323126:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323131:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323136:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323146:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323150:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323154:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323159:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323163:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323169:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323174:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323179:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323184:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323190:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323194:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323210:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323216:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323221:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323226:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323231:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323244:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323249:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323263:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323268:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323273:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323278:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323284:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323289:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323294:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323299:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323420:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323426:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.323432:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584022.325886:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98b43ed2d600:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1784584022.326040:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98b43e8f4800:8438] 1 exiting: rc = 0 00000100:00100000:2.0:1784584022.326338:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326345:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326350:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326356:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326362:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326367:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326372:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326391:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326415:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326422:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326427:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326433:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326438:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326443:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326449:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326454:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326460:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326490:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326497:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326503:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326522:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326529:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326545:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326551:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326556:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326563:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326568:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326574:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326580:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326586:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326591:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326597:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326617:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326624:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326630:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326636:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326643:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326648:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326654:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326659:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326665:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326670:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326676:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326681:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326711:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326718:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326724:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326730:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326736:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326742:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326748:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326753:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326760:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326765:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326771:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326776:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326796:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326809:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326814:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326820:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326837:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326844:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326850:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584022.326856:0:15801:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1784584022.350873:0:15801:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1784584038.282738:0:16566:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784584047.022464:0:17165:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784584047.024255:0:17165:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784584047.024257:0:17165:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784584047.024377:0:17165:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b3041fd000 00000020:01000004:0.0:1784584047.024395:0:17165:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784584047.024403:0:17165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784584047.024418:0:17165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98b4049db380) 00000020:00000080:0.0:1784584047.024432:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784584047.115129:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.115587:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784584047.117261:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.117773:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.117947:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.118116:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.118462:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.119114:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.119411:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.119730:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.119982:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784584047.120222:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.120699:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.120957:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784584047.122830:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784584047.123096:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784584047.123363:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.123712:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784584047.123899:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.124117:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.126748:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784584047.127341:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.127683:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.127878:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784584047.128123:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.128666:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.128849:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784584047.129132:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.129698:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.129964:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.130142:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.130530:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.130726:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.130945:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.131121:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.131346:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.131778:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.131963:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.132176:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.132667:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.132851:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.133113:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.133339:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.133772:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.134660:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784584047.135520:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784584047.137708:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.140848:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.141319:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.141595:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.141996:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.142359:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784584047.142920:0:17165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1784584047.143416:0:17165:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784584047.143673:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784584047.143682:0:17165:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784584047.143693:0:17165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e489eb 00000020:01000004:3.0:1784584047.143700:0:17165:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784584047.143705:0:17165:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784584047.143709:0:17165:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b3041fd000 from MGS 00000020:01000004:3.0:1784584047.143713:0:17165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784584047.143722:0:17165:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98b30247cd40) 00000020:00000080:3.0:1784584047.143732:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784584047.143789:0:17165:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b3041fd000 from MGS, refs=2 00080000:01000000:3.0:1784584047.143794:0:17165:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784584047.143798:0:17165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e489f9 00000100:00100000:3.0:1784584047.143884:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784584047.143990:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784584047.143995:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784584047.149724:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784584047.149824:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784584047.152084:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584047.152259:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784584047.152265:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784584047.156661:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784584047.156676:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784584047.160368:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784584047.160398:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1784584047.172651:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584047.172665:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584047.172668:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584047.173320:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584047.173324:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584047.173326:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584047.174102:0:17165:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784584047.185689:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784584047.187330:0:17165:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784584047.191245:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784584047.191316:0:17165:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784584047.191363:0:17165:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784584047.197007:0:17165:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784584047.197333:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584047.197533:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784584047.197551:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784584047.198327:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784584047.198336:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784584047.198666:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784584047.198672:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784584047.207357:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784584047.207396:0:17165:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.151@tcp' 00000020:01000004:1.0:1784584047.207398:0:17165:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784584047.207427:0:17165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.151@tcp (typ=mgc) 00000020:00000080:1.0:1784584047.207440:0:17165:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.151@tcp (ffff98b302a499c0) 00000020:00000080:1.0:1784584047.207457:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784584047.207587:0:17165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b404994800@MGC192.168.203.151@tcp: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784584047.207735:0:17165:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.151@tcp-0 is initialized 00000040:01000000:1.0:1784584047.207741:0:17165:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 1 is initialized 00000100:00080000:0.0:1784584047.208121:0:17182:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784584047.223160:0:17184:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784584047.223301:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.151@tcp (uuid f92bc391-87f9-4f08-829f-ff6dbf39f6d6) 00000020:00000080:1.0:1784584047.223327:0:17165:0:(genops.c:1406:class_connect()) connect: client f92bc391-87f9-4f08-829f-ff6dbf39f6d6, cookie 0xdab2421a42e48a07 00000100:00080000:1.0:1784584047.223339:0:17165:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584047.223345:0:17165:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b404994800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584047.223655:0:17165:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303962a00 x1871271599175168/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584047.223685:0:17165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS 00000020:01000004:1.0:1784584047.223711:0:17165:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784584047.223716:0:17165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784584047.223730:0:17165:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98b302a48000) 00000020:00000080:1.0:1784584047.223743:0:17165:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784584047.223899:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599175168:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784584047.223973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.224056:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175168 00000100:00100000:2.0:1784584047.224063:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175168 00000100:00100000:2.0:1784584047.224091:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584047.224097:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1871271599175168:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784584047.224119:0:17179:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f92bc391-87f9-4f08-829f-ff6dbf39f6d6@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1784584047.224138:0:17179:0:(genops.c:1406:class_connect()) connect: client f92bc391-87f9-4f08-829f-ff6dbf39f6d6, cookie 0xdab2421a42e48a15 00000100:00080000:2.0:1784584047.224264:0:17179:0:(import.c:65:import_set_state_nolock()) ffff98b418942800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584047.224314:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+5:3638:x1871271599175168:12345-0@lo:250:mount.lustre.0 Request processed in 215us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.224322:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584047.224367:0:3638:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784584047.224375:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1784584047.224394:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784584047.224397:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784584047.224406:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784584047.224409:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784584047.224416:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784584047.224422:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599175168:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784584047.246352:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584047.247462:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784584047.247792:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784584047.249917:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784584047.249929:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784584047.251378:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784584047.251391:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784584047.252313:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584047.253056:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784584047.253070:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784584047.258150:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784584047.258165:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784584047.332345:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584047.332576:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784584047.332583:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784584047.334178:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784584047.334189:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784584047.336298:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584047.336460:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784584047.336494:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784584047.342690:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784584047.342711:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784584047.345041:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584047.345220:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784584047.345226:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784584047.346012:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784584047.346021:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784584047.346854:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584047.347012:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784584047.347018:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784584047.347502:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784584047.347508:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784584047.385293:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584047.385811:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584047.385819:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784584047.392354:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584047.392376:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784584047.393980:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584047.394002:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784584047.400887:0:17165:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784584047.400917:0:17165:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784584047.400923:0:17165:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784584047.401032:0:17165:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784584047.401064:0:17165:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784584047.401068:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784584047.401070:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584047.401071:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584047.401072:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584047.401074:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584047.401075:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584047.401076:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584047.401078:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584047.401080:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584047.401081:0:17165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584047.401083:0:17165:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784584047.401085:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784584047.401086:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584047.401087:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584047.401088:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584047.401089:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584047.401090:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584047.401091:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584047.401093:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584047.401094:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584047.401100:0:17165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584047.401126:0:17165:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784584047.401145:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784584047.401283:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.401388:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.405108:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175296 00000100:00100000:3.0:1784584047.405133:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175296 00000100:00100000:3.0:1784584047.405241:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584047.405252:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+5:17165:x1871271599175296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784584047.405308:0:17181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784584047.405311:0:17181:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784584047.405314:0:17181:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784584047.413165:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784584047.417583:0:17181:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1784584047.426595:0:17203:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784584047.426603:0:17203:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784584047.426606:0:17203:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784584047.426609:0:17203:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784584047.427326:0:17203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784584047.427565:0:17181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584047.427577:0:17181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784584047.429674:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+5:17165:x1871271599175296:12345-0@lo:253:mount.lustre.0 Request processed in 24415us (28382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584047.429694:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584047.429968:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584047.429984:0:17165:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784584047.429987:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584047.429989:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584047.429991:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584047.429992:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584047.429993:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584047.429995:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584047.429996:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584047.429998:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584047.430000:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584047.430002:0:17165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784584047.430021:0:17165:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b3041fd000 from lustre-MDT0000 10000000:01000000:3.0:1784584047.430047:0:17165:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784584047.430050:0:17165:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784584047.430062:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98b302a499c0 10000000:01000000:3.0:1784584047.430066:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584047.430073:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b302a499c0 from 1 10000000:01000000:3.0:1784584047.430076:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784584047.430120:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.430132:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.430142:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.430162:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584047.430200:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.430247:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.430622:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175424 00000100:00100000:2.0:1784584047.430629:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175424 00000100:00100000:2.0:1784584047.430679:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584047.430688:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+5:17165:x1871271599175424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584047.430701:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584047.430716:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0600/0xdab2421a42e48a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48a1c expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.430740:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0600/0xdab2421a42e48a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48a1c expref: 6 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.430751:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0600/0xdab2421a42e48a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48a1c expref: 6 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.430760:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0600, rc 0) 00000100:00100000:2.0:1784584047.430867:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+6:17165:x1871271599175424:12345-0@lo:101:mount.lustre.0 Request processed in 179us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.430873:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584047.433092:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584047.433120:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.433133:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.433222:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584047.433276:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.433334:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584047.433730:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175552 00000100:00100000:1.0:1784584047.433737:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175552 00000100:00100000:1.0:1784584047.433788:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584047.433797:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+6:17165:x1871271599175552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584047.433903:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+6:17165:x1871271599175552:12345-0@lo:501:mount.lustre.0 Request processed in 107us (627us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584047.433911:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584047.434774:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784584047.434816:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784584047.434849:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.434860:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584047.434868:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b3041fd000 10000000:01000000:3.0:1784584047.434874:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784584047.434879:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b3041fd000 10000000:01000000:3.0:1784584047.435977:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784584047.435986:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b3041fd000 from 1 10000000:01000000:3.0:1784584047.435989:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784584047.436024:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.436035:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.436046:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.436066:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584047.436122:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.436182:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584047.436309:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175680 00000100:00100000:0.0:1784584047.436317:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175680 00000100:00100000:0.0:1784584047.436369:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584047.436378:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+6:17165:x1871271599175680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584047.436391:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584047.436406:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd9600/0xdab2421a42e48a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48a2a expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.436449:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd9600/0xdab2421a42e48a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48a2a expref: 7 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.436460:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd9600/0xdab2421a42e48a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48a2a expref: 7 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.436495:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9600, rc 0) 00000100:00100000:0.0:1784584047.436547:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+7:17165:x1871271599175680:12345-0@lo:101:mount.lustre.0 Request processed in 170us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584047.436553:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584047.437164:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584047.437181:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.437191:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584047.437228:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784584047.437284:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.437293:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584047.437301:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784584047.437306:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584047.437311:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b3041fd000 10000000:01000000:3.0:1784584047.437313:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784584047.437317:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784584047.437319:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784584047.437347:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.437355:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.437363:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.437378:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584047.437410:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.437452:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584047.438790:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175808 00000100:00100000:1.0:1784584047.438803:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175808 00000100:00100000:1.0:1784584047.438871:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584047.438890:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+7:17165:x1871271599175808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584047.438905:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584047.438925:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cf000/0xdab2421a42e48a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48a38 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.438951:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cf000/0xdab2421a42e48a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48a38 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.438961:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cf000/0xdab2421a42e48a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48a38 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.438970:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf000, rc 0) 00000100:00100000:1.0:1784584047.439038:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+8:17165:x1871271599175808:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584047.439045:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584047.439187:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584047.439205:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.439229:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.439301:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584047.439335:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.439386:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584047.439606:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599175936 00000100:00100000:0.0:1784584047.439613:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599175936 00000100:00100000:0.0:1784584047.439654:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584047.439663:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+8:17165:x1871271599175936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584047.439815:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17165:x1871271599175936:12345-0@lo:501:mount.lustre.0 Request processed in 154us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584047.439824:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584047.440836:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599175936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584047.440891:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584047.440949:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.440996:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584047.441196:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176064 00000100:00100000:1.0:1784584047.441203:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176064 00000100:00100000:1.0:1784584047.441301:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584047.441310:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17165:x1871271599176064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584047.442719:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17165:x1871271599176064:12345-0@lo:503:mount.lustre.0 Request processed in 1405us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584047.442740:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584047.443130:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584047.445215:0:17204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17204:1871271599176192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.445291:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.445410:0:17204:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.446596:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176192 00000100:00100000:2.0:1784584047.446607:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176192 00000100:00100000:2.0:1784584047.446701:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584047.446712:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17204:x1871271599176192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.448073:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17204:x1871271599176192:12345-0@lo:502:llog_process_th.0 Request processed in 1359us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.448086:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584047.448173:0:17204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17204:1871271599176192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784584047.448211:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584047.448223:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.448225:0:17204:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784584047.448231:0:17204:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784584047.448234:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584047.448250:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98b302478000) 00000020:00000080:3.0:1784584047.448267:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784584047.448272:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784584047.448363:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784584047.448371:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48a4d 00000020:00000080:3.0:1784584047.448618:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784584047.448623:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584047.448626:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.448628:0:17204:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784584047.448630:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584047.448633:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.448635:0:17204:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784584047.448638:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584047.448645:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98b30247b380) 00000020:00000080:3.0:1784584047.448655:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784584047.448659:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784584047.448661:0:17204:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784584047.448663:0:17204:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784584047.448669:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784584047.448705:0:17204:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b3041fd000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784584047.448718:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98b3024799c0) 00000020:00000080:3.0:1784584047.448725:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784584047.448780:0:17204:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784584047.448786:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48a62 00000020:00000080:3.0:1784584047.448876:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784584047.448882:0:17204:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784584047.448886:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdab2421a42e48a69 00080000:01000000:3.0:1784584047.448891:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784584047.448894:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48a70 00010000:00010000:1.0:1784584047.515956:0:17204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1784584047.516866:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:1.0:1784584047.517522:0:17204:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784584047.521878:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98b302a4b380) 00000020:00000080:1.0:1784584047.522137:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784584047.522366:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784584047.522374:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48a7e 00000020:00000080:0.0:1784584047.527241:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784584047.534952:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdab2421a42e48a85 00000020:00000080:2.0:1784584047.537994:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784584047.538015:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.538022:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.538024:0:17204:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784584047.538028:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784584047.538030:0:17204:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784584047.538031:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584047.538033:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584047.538034:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784584047.538036:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.538037:0:17204:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784584047.538039:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.538044:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.538045:0:17204:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784584047.538049:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784584047.538102:0:17204:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784584047.538126:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.538130:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.538131:0:17204:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784584047.538134:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.538137:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.538138:0:17204:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784584047.538140:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784584047.538143:0:17204:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:2.0:1784584047.538170:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584047.538181:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98b4071a8000) 00000020:00000080:2.0:1784584047.538195:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784584047.538198:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784584047.538247:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784584047.538251:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784584047.538254:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48a93 00010000:00080000:2.0:1784584047.538276:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43cb02000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584047.539883:0:17204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1784584047.541766:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784584047.541780:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784584047.541815:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784584047.541835:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48a9a 00000100:00080000:1.0:1784584047.541845:0:17204:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584047.541850:0:17204:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b43cb02000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584047.541886:0:17204:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303961880 x1871271599176320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584047.541915:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784584047.541971:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584047.541975:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584047.541977:0:17204:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784584047.541980:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784584047.541982:0:17204:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1784584047.541984:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584047.541985:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584047.541986:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784584047.541989:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584047.541991:0:17204:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784584047.541993:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584047.541997:0:17204:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784584047.542000:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584047.542012:0:17204:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784584047.542017:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784584047.542020:0:17204:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1784584047.542042:0:17204:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784584047.542045:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584047.542057:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98b302a4cd40) 00000020:00000080:1.0:1784584047.542068:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784584047.542072:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784584047.542143:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784584047.542149:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784584047.542154:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48aa8 00010000:00080000:1.0:1784584047.542182:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43cb07800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.151@tcp at head 00000100:00100000:3.0:1784584047.542594:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584047.542670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584047.543066:0:17204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1784584047.543710:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176320 00000100:00100000:2.0:1784584047.543720:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176320 00000100:00100000:2.0:1784584047.543757:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584047.543764:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599176320:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1784584047.543781:0:17191:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1784584047.546050:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584047.546668:0:17204:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784584047.554581:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584047.556114:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1784584047.568959:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1784584047.577840:0:17210:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584047.577855:0:17210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784584047.579238:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584047.579277:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784584047.579394:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784584047.579706:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48aaf 00000100:00080000:3.0:1784584047.579718:0:17204:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584047.579724:0:17204:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b43cb07800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584047.579772:0:17204:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a4000 x1871271599176448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584047.579865:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176448:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784584047.579962:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599176448 offset 0 length 520: 4 00000100:00080000:3.0:1784584047.580186:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784584047.580266:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584047.580271:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.580272:0:17204:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784584047.580275:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784584047.580278:0:17204:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784584047.580279:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784584047.580281:0:17204:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784584047.580282:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784584047.580285:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.580287:0:17204:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784584047.580289:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784584047.580293:0:17204:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784584047.580296:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.580297:0:17204:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784584047.580300:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784584047.580304:0:17204:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:3.0:1784584047.580324:0:17204:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784584047.580326:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584047.580338:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98b42e933380) 00000020:00000080:3.0:1784584047.580351:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1784584047.580356:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784584047.580415:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784584047.580421:0:17204:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784584047.580426:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e48abd 00010000:00080000:3.0:1784584047.580512:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43e8cb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784584047.581175:0:17204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1784584047.581263:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784584047.581279:0:17204:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784584047.585725:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584047.585999:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1784584047.586256:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784584047.586789:0:17212:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584047.586795:0:17212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1784584047.587319:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599176320:12345-0@lo:38:llog_process_th.0 Request processed in 43548us (44643us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784584047.587333:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1784584047.587800:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584047.587813:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784584047.587849:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784584047.587872:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48ac4 00000100:00080000:3.0:1784584047.587893:0:17204:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584047.587899:0:17204:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b43e8cb800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584047.587935:0:17204:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a5500 x1871271599176576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584047.587951:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784584047.588297:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584047.588301:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.588303:0:17204:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784584047.588307:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584047.588311:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.588312:0:17204:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784584047.588315:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784584047.588316:0:17204:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784584047.588319:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584047.588321:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.588322:0:17204:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784584047.588324:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584047.588327:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.588328:0:17204:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784584047.588332:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784584047.588368:0:17204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17204:1871271599176704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.588447:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.588518:0:17204:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f51180 going to sleep for 11 seconds 00000100:00080000:1.0:1784584047.590216:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584047.590226:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784584047.590232:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584047.590277:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176704 00000100:00100000:1.0:1784584047.590284:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176704 00000100:00100000:1.0:1784584047.590341:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584047.590351:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17204:x1871271599176704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584047.590524:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17204:x1871271599176704:12345-0@lo:502:llog_process_th.0 Request processed in 173us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584047.590542:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584047.590598:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176576:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784584047.590716:0:17204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17204:1871271599176704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784584047.590751:0:17204:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584047.590758:0:17204:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584047.590760:0:17204:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784584047.590764:0:17204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000400:00000100:1.0:1784584047.591425:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599176576 offset 0 length 520: 4 00000020:01000000:2.0:1784584047.591763:0:17165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1784584047.591787:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784584047.591810:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.591821:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584047.591828:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b3041fd000 from 1 10000000:01000000:2.0:1784584047.591831:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784584047.591863:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.592121:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.592131:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584047.592151:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584047.592190:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.592256:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.592294:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176832 00000100:00100000:3.0:1784584047.592301:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176832 00000100:00100000:3.0:1784584047.592341:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584047.592349:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+9:17165:x1871271599176832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584047.592361:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584047.592377:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48acb expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.592398:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48acb expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.592407:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48acb expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.592415:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784584047.592558:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+10:17165:x1871271599176832:12345-0@lo:101:mount.lustre.0 Request processed in 210us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.592565:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584047.592774:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584047.592789:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.592796:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584047.593578:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176960:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784584047.593736:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.593801:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.593856:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599176960 00000100:00100000:3.0:1784584047.593862:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599176960 00000100:00100000:3.0:1784584047.594107:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584047.594117:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+10:17165:x1871271599176960:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784584047.594136:0:17180:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784584047.594143:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784584047.594357:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+10:17165:x1871271599176960:12345-0@lo:256:mount.lustre.0 Request processed in 240us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.594372:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584047.594563:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599176960:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784584047.595784:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584047.595839:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.595848:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584047.595903:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b3041fd000 from 1 10000000:01000000:0.0:1784584047.595905:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584047.595933:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.595938:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.595945:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584047.595974:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584047.596086:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584047.596119:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407480240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.596586:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177088 00000100:00100000:3.0:1784584047.596593:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177088 00000100:00100000:3.0:1784584047.596638:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584047.596646:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+10:17165:x1871271599177088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584047.596657:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584047.596670:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48ad9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.596691:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.596701:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.596709:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96e00, rc 0) 00000100:00100000:3.0:1784584047.596747:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177088:12345-0@lo:101:mount.lustre.0 Request processed in 102us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.596753:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584047.596982:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584047.596996:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.597103:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584047.597185:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584047.597210:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584047.597237:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407480240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.597284:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177216 00000100:00100000:3.0:1784584047.597288:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177216 00000100:00100000:3.0:1784584047.597315:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584047.597322:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584047.597456:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177216:12345-0@lo:501:mount.lustre.0 Request processed in 134us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.597463:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584047.597605:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584047.597641:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584047.597678:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.597704:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.597801:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177344 00000100:00100000:3.0:1784584047.597811:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177344 00000100:00100000:3.0:1784584047.597826:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584047.597831:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584047.597915:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177344:12345-0@lo:503:mount.lustre.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.597921:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584047.598128:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584047.598545:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17214:1871271599177472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.598588:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.598623:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.598747:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177472 00000100:00100000:3.0:1784584047.598752:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177472 00000100:00100000:3.0:1784584047.598773:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584047.598779:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17214:x1871271599177472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.599433:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17214:x1871271599177472:12345-0@lo:502:llog_process_th.0 Request processed in 651us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.599440:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584047.599582:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17214:1871271599177472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584047.599605:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.599622:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599625:0:17214:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584047.599631:0:17214:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b3041fd000 00000020:00000080:2.0:1784584047.599634:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584047.599642:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.599645:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599646:0:17214:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584047.599648:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.599651:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599652:0:17214:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584047.599655:0:17214:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b3041fd000 00000020:00000080:2.0:1784584047.599658:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584047.599715:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.599719:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599720:0:17214:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584047.599723:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.599725:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599726:0:17214:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584047.599729:0:17214:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b3041fd000 00000020:00000080:2.0:1784584047.599731:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584047.599747:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.599749:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599751:0:17214:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584047.599753:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584047.599755:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.599756:0:17214:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784584047.599759:0:17214:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b3041fd000 00000020:00000080:2.0:1784584047.599761:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784584047.599805:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17214:1871271599177600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.599840:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.599862:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.601269:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177600 00000100:00100000:2.0:1784584047.601278:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177600 00000100:00100000:2.0:1784584047.601323:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584047.601332:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17214:x1871271599177600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.601460:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17214:x1871271599177600:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.601482:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584047.601549:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17214:1871271599177600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584047.601578:0:17214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584047.601585:0:17214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584047.601587:0:17214:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784584047.601591:0:17214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784584047.608567:0:17165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784584047.608731:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584047.608759:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.608772:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584047.608848:0:17165:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784584047.608852:0:17165:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b3041fd000 10000000:01000000:1.0:1784584047.608855:0:17165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b3041fd000 10000000:01000000:1.0:1784584047.608859:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584047.608865:0:17165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b3041fd000 from 1 10000000:01000000:1.0:1784584047.608868:0:17165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584047.609307:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.609319:0:17165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.609330:0:17165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584047.609354:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584047.609425:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584047.609552:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.611247:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177728 00000100:00100000:2.0:1784584047.611263:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177728 00000100:00100000:2.0:1784584047.611324:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784584047.611338:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17165:x1871271599177728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584047.611358:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584047.611376:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0000/0xdab2421a42e48aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48ae7 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.611407:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0000/0xdab2421a42e48aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48ae7 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.611419:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0000/0xdab2421a42e48aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48ae7 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.611441:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0000, rc 0) 00000100:00100000:2.0:1784584047.611530:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599177728:12345-0@lo:101:mount.lustre.0 Request processed in 195us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584047.611792:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584047.611821:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.611833:0:17165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584047.612142:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584047.612146:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584047.612193:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584047.612238:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.616310:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177856 00000100:00100000:2.0:1784584047.616325:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177856 00000100:00100000:2.0:1784584047.616377:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584047.616387:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599177856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584047.616583:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599177856:12345-0@lo:501:mount.lustre.0 Request processed in 197us (4390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.616591:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584047.617757:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584047.617815:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584047.617872:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.617918:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.617936:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599177984 00000100:00100000:2.0:1784584047.617941:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599177984 00000100:00100000:2.0:1784584047.618721:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584047.618733:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599177984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584047.618840:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599177984:12345-0@lo:503:mount.lustre.0 Request processed in 109us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.618847:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584047.618907:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599177984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584047.621205:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.621291:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.621330:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178112 00000100:00100000:2.0:1784584047.621337:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178112 00000100:00100000:2.0:1784584047.621379:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584047.621389:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.621598:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178112:12345-0@lo:502:llog_process_th.0 Request processed in 210us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584047.621606:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584047.621805:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.621827:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178112:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784584047.621951:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784584047.621976:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98b4071acd40) 00000020:00000080:2.0:1784584047.621995:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1784584047.622257:0:17219:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b3041fd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784584047.622262:0:17219:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b3041fd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784584047.622264:0:17219:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b3041fd000 4 00010000:00080000:2.0:1784584047.622297:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b416bda800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784584047.629913:0:17219:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1784584047.630190:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784584047.630237:0:17219:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584047.630251:0:17219:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdab2421a42e48afc 00000100:00080000:3.0:1784584047.630261:0:17219:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584047.630266:0:17219:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98b416bda800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584047.630298:0:17219:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a7100 x1871271599178240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584047.630337:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599178240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584047.630403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784584047.630505:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784584047.633170:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.633249:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.633308:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178368 00000100:00100000:3.0:1784584047.633315:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178368 00000100:00100000:3.0:1784584047.633362:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584047.633371:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.633500:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178368:12345-0@lo:502:llog_process_th.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.633508:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584047.633515:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b404d0b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584047.633547:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.633589:0:17219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584047.633623:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.633648:0:17219:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff540 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.633695:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178496 00000100:00100000:3.0:1784584047.633700:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178496 00000100:00100000:3.0:1784584047.633731:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584047.633738:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584047.633810:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17219:x1871271599178496:12345-0@lo:502:llog_process_th.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.633816:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584047.633890:0:17219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17219:1871271599178496:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784584047.633909:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784584047.633969:0:17165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784584047.634003:0:17165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584047.634016:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584047.634026:0:17165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584047.634073:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584047.634075:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584047.634076:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584047.634078:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584047.634079:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584047.634080:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584047.634081:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584047.634083:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584047.634084:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584047.634085:0:17165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584047.634089:0:17165:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784584047.634091:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584047.634092:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584047.634093:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584047.634095:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584047.634096:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584047.634097:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584047.634098:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584047.634099:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584047.634100:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584047.634101:0:17165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584047.634244:0:17165:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784584047.634254:0:17165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599178624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584047.634282:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584047.634296:0:17165:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7ff540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584047.634516:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178240 00000100:00100000:1.0:1784584047.634522:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178240 00000100:00100000:1.0:1784584047.634561:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584047.634567:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599178240:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584047.634634:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599178240:12345-0@lo:38:llog_process_th.0 Request processed in 65us (4230us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784584047.634641:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584047.634717:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178624 00000100:00100000:3.0:1784584047.634721:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178624 00000100:00100000:3.0:1784584047.634752:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584047.634758:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599178624:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584047.634768:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584047.634775:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bda800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 20000000:01000000:3.0:1784584047.634777:0:17179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:2.0:1784584047.634779:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784584047.634787:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599178240:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1784584047.634789:0:17179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784584047.637308:0:17179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784584047.637327:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784584047.637421:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784584047.637426:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784584047.637447:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.637464:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.637500:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.637544:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584047.637568:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584047.637582:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599178752:0@lo:104: 00000100:00100000:1.0:1784584047.637648:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584047.637686:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584047.637979:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17165:x1871271599178624:12345-0@lo:253:mount.lustre.0 Request processed in 3219us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.637989:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584047.638246:0:17165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17165:1871271599178624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584047.638257:0:17165:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784584047.638260:0:17165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584047.638261:0:17165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584047.638263:0:17165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584047.638264:0:17165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584047.638265:0:17165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584047.638266:0:17165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584047.638267:0:17165:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584047.638269:0:17165:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584047.638270:0:17165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584047.638271:0:17165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584047.638284:0:17165:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784584047.638385:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178752 00000100:00100000:0.0:1784584047.638392:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178752 00000100:00100000:0.0:1784584047.638434:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584047.638449:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599178752:12345-0@lo:104: 00010000:00010000:0.0:1784584047.638462:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584047.638540:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584047.638546:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599178752:12345-0@lo:104: Request processed in 99us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584047.638553:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584047.638571:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599178752:0@lo:104: 00010000:00010000:1.0:1784584047.638585:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.641990:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584047.642093:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.642117:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584047.642121:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.642132:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584047.642140:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584047.642146:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584047.642194:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.642199:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584047.642220:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.642228:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b3041c0400/0xdab2421a42e48acb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ad2 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.642247:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584047.642248:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584047.642250:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584047.642283:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599178880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584047.642336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584047.644157:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599178880 00000100:00100000:3.0:1784584047.644169:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599178880 00010000:00010000:3.0:1784584047.644206:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.644256:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584047.644265:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:3640:x1871271599178880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584047.644279:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584047.644284:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644295:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644310:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48ad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48acb expref: 12 pid: 17181 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644326:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644334:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584047.644349:0:17171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006922807s 00010000:00010000:3.0:1784584047.644353:0:17171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644359:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644365:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644371:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644383:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584047.644387:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644394:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644410:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644420:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584047.644511:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:3640:x1871271599178880:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584047.644519:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784584047.644555:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644562:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584047.644568:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce000/0xdab2421a42e48b03 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584047.644605:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599178880:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784584047.660126:0:17165:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1784584047.662597:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784584047.664275:0:17226:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784584047.664284:0:17226:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1784584047.669075:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784584047.669718:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784584047.670750:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1784584047.672110:0:17228:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98b409219c00 x1871271599179008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584047.672126:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000040:01000000:0.0:1784584047.674253:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784584047.674297:0:17165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784584047.674762:0:17165:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784584047.674771:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784584047.674810:0:17165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584047.677334:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784584047.677423:0:17227:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784584047.678367:0:17165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784584047.679355:0:17165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784584047.679411:0:17165:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784584047.680930:0:17165:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1784584047.681720:0:17165:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1784584047.684412:0:17165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1784584047.687398:0:17165:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784584047.687442:0:17165:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb9d4191b988 00100000:10000000:0.0:1784584047.687450:0:17165:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784584047.689148:0:17165:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784584047.689164:0:17165:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784584047.689182:0:17165:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784584047.689213:0:17165:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784584047.692874:0:17165:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584047.694228:0:17165:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784584048.238394:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584048.686800:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000040:00080000:0.0:1784584048.688269:0:17220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584048.688279:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584048.689984:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1784584048.689995:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1784584049.197590:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784584049.197598:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b3041fd000 from 7 10000000:01000000:0.0:1784584049.197610:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784584049.197655:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584049.197668:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584049.197679:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584049.197708:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599179136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784584049.197782:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584049.197837:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584049.197901:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179136 00000100:00100000:3.0:1784584049.197909:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179136 00000100:00100000:3.0:1784584049.197968:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584049.197978:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+11:17184:x1871271599179136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584049.197992:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584049.198005:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48b0a expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584049.198038:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584049.198049:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584049.198057:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784584049.198101:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17184:x1871271599179136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584049.198108:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784584049.198335:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599179136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584049.198350:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584049.198358:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584049.198409:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599179264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784584049.198442:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584049.198487:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eb52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584049.198546:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179264 00000100:00100000:3.0:1784584049.198550:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179264 00000100:00100000:3.0:1784584049.198582:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584049.198589:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17184:x1871271599179264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584049.198602:0:17179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584049.198617:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584049.198621:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784584049.198705:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17184:x1871271599179264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584049.198712:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784584049.198775:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599179264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584049.198815:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584049.198821:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584049.198837:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584049.261815:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584049.709684:0:17220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584049.709693:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584049.709820:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1784584049.709855:0:17220:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584049.710004:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:3.0:1784584049.716803:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1784584050.286196:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584050.733561:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1784584051.311304:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584051.759270:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000001:02000400:3.0:1784584052.106150:0:17471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784584052.340190:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584052.786444:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000100:00080000:2.0:1784584052.919248:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784584052.919256:0:473:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784584052.919260:0:473:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584052.919269:0:473:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:2.0:1784584052.919276:0:473:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584052.919283:0:473:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b43cb02000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584052.919545:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599179392:0@lo:400:kworker.0 00000100:00100000:0.0:1784584052.919619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584052.919685:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179392 00000100:00100000:0.0:1784584052.919692:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179392 00000100:00100000:0.0:1784584052.919736:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584052.919745:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:3641:x1871271599179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584052.919793:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:3641:x1871271599179392:12345-0@lo:400:kworker.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584052.919800:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584052.921239:0:473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b409218700 x1871271599179520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584052.921282:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584052.921286:0:473:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584052.921289:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584052.921291:0:473:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584052.921294:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784584052.921298:0:473:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784584052.921300:0:473:0:(import.c:65:import_set_state_nolock()) ffff98b416bda800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584052.921366:0:473:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98b416bda800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584052.921400:0:473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b409218000 x1871271599179648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584052.922542:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599179520:0@lo:38:kworker.0 00000100:00100000:2.0:1784584052.922617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584052.922665:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599179648:0@lo:38:kworker.0 00000100:00100000:2.0:1784584052.922691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584052.922765:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179648 00000100:00100000:2.0:1784584052.922772:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179648 00000100:00100000:2.0:1784584052.922807:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584052.922814:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599179648:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784584052.922840:0:17188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000100:00100000:0.0:1784584052.923103:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599179392:0@lo:400:kworker.0 00000100:00100000:3.0:1784584052.923770:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179520 00000100:00100000:3.0:1784584052.923780:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179520 00000100:00100000:3.0:1784584052.923806:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584052.923821:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599179520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784584052.923837:0:17192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1784584052.926353:0:17188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdab2421a42e48b18 00000004:00100000:2.0:1784584052.926378:0:17188:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784584052.926563:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b43ca6b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584052.926675:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1871271599179648:12345-0@lo:38:kworker.0 Request processed in 3857us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584052.926702:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784584052.927271:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b409218000 x1871271599179648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584052.927293:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784584052.927302:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784584052.927307:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784584052.927318:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bda800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784584052.927325:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599179648:0@lo:38:kworker.0 00000100:00100000:3.0:1784584052.957879:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599179520:12345-0@lo:38:kworker.0 Request processed in 34045us (35250us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584052.957897:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784584052.957950:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584052.957955:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784584052.957959:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599179520:0@lo:38:kworker.0 00000020:00000004:3.0:1784584053.025810:0:17523:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584053.026949:0:17523:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584053.357907:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584053.805816:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000020:00000004:3.0:1784584053.924166:0:17573:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584053.925013:0:17573:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784584054.381579:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584054.838913:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1784584055.409751:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584055.857344:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1784584056.431164:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584056.877595:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1784584057.009347:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584047/real 1784584047] req@ffff98b3048a5500 x1871271599176576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584057.009377:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a5500 x1871271599176576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584057.009387:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584047/real 1784584047] req@ffff98b3048a4000 x1871271599176448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584057.009399:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a4000 x1871271599176448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584057.009429:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584057.009444:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584057.009448:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176576:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784584057.009453:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584057.009458:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584057.009461:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599176448:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784584057.009686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784584057.009690:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784584057.009693:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584057.009698:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:3.0:1784584057.009703:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784584057.009709:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b43cb02000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584057.009729:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a4380 x1871271599179904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584057.009753:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584057.009756:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784584057.009757:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584057.009761:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1784584057.009763:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784584057.009767:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b43cb07800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584057.009780:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a6300 x1871271599180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584057.009787:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584057.009790:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784584057.009791:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584057.009794:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1784584057.009796:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784584057.009799:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b43e8cb800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584057.009808:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a6680 x1871271599180160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584057.009941:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599180288:0@lo:400:kworker.0 00000100:00100000:3.0:1784584057.010086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584057.010188:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599179776:0@lo:400:kworker.0 00000100:00100000:1.0:1784584057.010220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584057.010266:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180288 00000100:00100000:1.0:1784584057.010273:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180288 00000100:00100000:1.0:1784584057.010315:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584057.010324:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584057.010372:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599180288:12345-0@lo:400:kworker.0 Request processed in 49us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584057.010379:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784584057.010420:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b3048a5880 x1871271599180288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584057.010430:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599180288:0@lo:400:kworker.0 00000100:00100000:1.0:1784584057.010448:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599179904:0@lo:38:kworker.0 00000100:00100000:1.0:1784584057.010508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584057.010528:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599180032:0@lo:8:kworker.0 00000400:00000100:1.0:1784584057.010549:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599180032 offset 0 length 520: 4 00000100:00100000:1.0:1784584057.010565:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599180160:0@lo:8:kworker.0 00000400:00000100:1.0:1784584057.010591:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599180160 offset 0 length 520: 4 00000100:00100000:1.0:1784584057.010617:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179904 00000100:00100000:1.0:1784584057.010621:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179904 00000100:00100000:1.0:1784584057.010642:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584057.010712:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599179904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784584057.010729:0:17191:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784584057.011773:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179776 00000100:00100000:3.0:1784584057.011784:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179776 00000100:00100000:3.0:1784584057.011835:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584057.011842:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:3642:x1871271599179776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584057.011914:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:3642:x1871271599179776:12345-0@lo:400:kworker.0 Request processed in 73us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584057.011933:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584057.018829:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599179776:0@lo:400:kworker.0 00000100:00100000:1.0:1784584057.022395:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599179904:12345-0@lo:38:kworker.0 Request processed in 11738us (11878us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784584057.022409:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784584057.023038:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584057.023046:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784584057.023050:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599179904:0@lo:38:kworker.0 00010000:00010000:3.0:1784584057.465330:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584057.901534:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1784584058.481113:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584058.925989:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1784584059.503716:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584059.949525:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000040:00080000:2.0:1784584059.950159:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1784584059.984729:0:17918:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784584059.984734:0:17918:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784584059.984736:0:17918:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784584059.984868:0:17918:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b437661000 00000020:01000004:0.0:1784584059.984884:0:17918:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1784584059.984896:0:17918:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784584059.984909:0:17918:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98b4049dcd40) 00000020:00000080:0.0:1784584059.984925:0:17918:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784584060.104465:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.104882:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784584060.107791:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.108867:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.109249:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.109780:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.110858:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.111246:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.111440:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.112118:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.112763:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.113332:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.113912:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.117286:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.118844:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.119288:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.119552:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.120838:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.121992:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.122405:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.122712:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.123163:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.123369:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.123593:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.124119:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.124781:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.125717:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.126062:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.127963:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784584060.128429:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.128773:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.129038:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.129266:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784584060.129692:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1784584060.133512:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.134231:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.134500:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1784584060.134843:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1784584060.135236:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.135489:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.135787:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.136150:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1784584060.136773:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1784584060.137011:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1784584060.138364:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784584060.138650:0:17918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1784584060.139770:0:17918:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784584060.140000:0:17918:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1784584060.140010:0:17918:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784584060.140036:0:17918:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48b26 00000020:01000004:0.0:1784584060.140045:0:17918:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784584060.140064:0:17918:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784584060.140067:0:17918:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784584060.140072:0:17918:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1784584060.140097:0:17918:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1784584060.140101:0:17918:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1784584060.152448:0:17918:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584060.156989:0:17918:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1784584060.156997:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584060.156999:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784584060.157000:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584060.157002:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584060.157003:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584060.157005:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584060.157006:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584060.157008:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584060.157009:0:17918:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584060.157014:0:17918:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1784584060.157016:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584060.157032:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784584060.157033:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584060.157034:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584060.157035:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584060.157036:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584060.157037:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584060.157038:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584060.157039:0:17918:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584060.157066:0:17918:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784584060.157092:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584060.157172:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.157228:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584060.158972:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180416 00000100:00100000:0.0:1784584060.158985:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180416 00000100:00100000:0.0:1784584060.159057:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784584060.159068:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17918:x1871271599180416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584060.159122:0:17179:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784584060.159126:0:17179:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1784584060.159133:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784584060.159562:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17918:x1871271599180416:12345-0@lo:253:mount.lustre.0 Request processed in 495us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.159570:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584060.159661:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584060.159674:0:17918:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784584060.159677:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584060.159679:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584060.159680:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584060.159682:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584060.159683:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584060.159684:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584060.159685:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584060.159687:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584060.159689:0:17918:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784584060.159709:0:17918:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b437661000 from lustre-MDT0001 10000000:01000000:2.0:1784584060.159736:0:17918:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784584060.159745:0:17918:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784584060.159752:0:17918:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302a499c0 local copy 00010000:00010000:2.0:1784584060.159761:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584060.159871:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584060.159903:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.159938:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584060.160040:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180544 00000100:00100000:0.0:1784584060.160044:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180544 00000100:00100000:0.0:1784584060.160082:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784584060.160089:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17918:x1871271599180544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584060.160152:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17918:x1871271599180544:12345-0@lo:501:mount.lustre.0 Request processed in 62us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784584060.160159:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584060.160285:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180544:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784584060.160297:0:17918:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784584060.160314:0:17918:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784584060.160320:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.160328:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584060.160349:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b437661000 10000000:01000000:2.0:1784584060.160354:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784584060.160359:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98b302a499c0 10000000:01000000:2.0:1784584060.160361:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784584060.160364:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98b302a499c0 from 1 10000000:01000000:2.0:1784584060.160367:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784584060.160389:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.160396:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.160418:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584060.160431:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584060.160494:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.160509:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.160690:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180672 00000100:00100000:1.0:1784584060.160695:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180672 00000100:00100000:1.0:1784584060.160732:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584060.160738:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+12:17918:x1871271599180672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.160748:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584060.160764:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cee00/0xdab2421a42e48b34 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48b2d expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.160785:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cee00/0xdab2421a42e48b34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48b2d expref: 13 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.160795:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cee00/0xdab2421a42e48b34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48b2d expref: 13 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.160876:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cee00, rc 0) 00000100:00100000:1.0:1784584060.160910:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+13:17918:x1871271599180672:12345-0@lo:101:mount.lustre.0 Request processed in 172us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.160916:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584060.162592:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584060.162615:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.162626:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584060.162647:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784584060.162666:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.162673:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584060.162683:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b437661000 10000000:01000000:2.0:1784584060.162690:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784584060.162695:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b437661000 from 1 10000000:01000000:2.0:1784584060.162697:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784584060.162723:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.162730:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.162752:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584060.162769:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584060.162825:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.162859:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.163918:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180800 00000100:00100000:1.0:1784584060.163928:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180800 00000100:00100000:1.0:1784584060.163982:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784584060.163991:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+13:17918:x1871271599180800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.164006:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584060.164020:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172ce600/0xdab2421a42e48b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48b3b expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164060:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce600/0xdab2421a42e48b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48b3b expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164070:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172ce600/0xdab2421a42e48b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48b3b expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164079:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce600, rc 0) 00000100:00100000:1.0:1784584060.164129:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+14:17918:x1871271599180800:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.164135:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584060.164295:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584060.164310:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.164319:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584060.164334:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784584060.164348:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.164355:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584060.164362:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784584060.164366:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584060.164370:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b437661000 10000000:01000000:2.0:1784584060.164372:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784584060.164375:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784584060.164377:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784584060.164396:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.164409:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.164416:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584060.164432:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584060.164501:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.164531:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.164633:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599180928 00000100:00100000:1.0:1784584060.164637:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599180928 00000100:00100000:1.0:1784584060.164671:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584060.164678:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+14:17918:x1871271599180928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.164686:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584060.164695:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cf400/0xdab2421a42e48b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48b49 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164708:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cf400/0xdab2421a42e48b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48b49 expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164716:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cf400/0xdab2421a42e48b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48b49 expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.164722:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf400, rc 0) 00000100:00100000:1.0:1784584060.164750:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599180928:12345-0@lo:101:mount.lustre.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.164756:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584060.164908:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599180928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584060.164918:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.164925:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584060.166234:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1784584060.167332:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584060.172297:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784584060.172359:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1784584060.172378:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1784584060.172392:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1784584060.172405:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1784584060.172419:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1784584060.172432:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1784584060.172442:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1784584060.172500:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1784584060.172521:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1784584060.172547:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1784584060.172560:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1784584060.172571:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1784584060.172584:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1784584060.172598:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1784584060.172611:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1784584060.172621:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1784584060.172633:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1784584060.172648:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1784584060.172661:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1784584060.172673:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1784584060.172684:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1784584060.172696:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1784584060.172723:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1784584060.172729:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1784584060.172830:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584060.172893:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.172934:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584060.173170:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181056 00000100:00100000:0.0:1784584060.173177:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181056 00000100:00100000:0.0:1784584060.173217:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584060.173233:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584060.173379:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181056:12345-0@lo:501:mount.lustre.0 Request processed in 146us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.173388:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784584060.173690:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584060.173723:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584060.173764:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.173831:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584060.174205:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181184 00000100:00100000:0.0:1784584060.174211:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181184 00000100:00100000:0.0:1784584060.174252:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584060.174260:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584060.175077:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181184:12345-0@lo:503:mount.lustre.0 Request processed in 816us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.175086:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784584060.175271:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584060.177243:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584060.177346:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584060.177424:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.177514:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.177656:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181312 00000100:00100000:2.0:1784584060.177663:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181312 00000100:00100000:2.0:1784584060.177706:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584060.177716:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584060.178983:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181312:12345-0@lo:502:mount.lustre.0 Request processed in 1264us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.178995:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784584060.179611:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584060.179877:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784584060.179910:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1784584060.179926:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1784584060.179940:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1784584060.179953:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1784584060.179966:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1784584060.179977:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1784584060.179988:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1784584060.180002:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1784584060.180015:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1784584060.180327:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1784584060.180342:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1784584060.180355:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1784584060.180370:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1784584060.180383:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1784584060.180396:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1784584060.180408:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1784584060.180420:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1784584060.180446:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1784584060.180499:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1784584060.180516:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1784584060.180530:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1784584060.180543:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1784584060.180556:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1784584060.180569:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1784584060.180582:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1784584060.180596:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1784584060.180608:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1784584060.180621:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1784584060.180634:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1784584060.180648:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1784584060.180660:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1784584060.180671:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1784584060.180684:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1784584060.180696:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1784584060.180710:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1784584060.180724:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1784584060.180737:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1784584060.180751:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1784584060.180763:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1784584060.180777:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1784584060.180789:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1784584060.180817:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1784584060.180832:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1784584060.180878:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584060.180946:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.180999:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.181162:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181440 00000100:00100000:2.0:1784584060.181169:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181440 00000100:00100000:2.0:1784584060.181222:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584060.181231:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584060.181342:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599181440:12345-0@lo:502:mount.lustre.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.181350:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584060.181463:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599181440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584060.181534:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1784584060.181542:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1784584060.182389:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.182402:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.182404:0:17922:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784584060.182410:0:17922:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1784584060.182412:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584060.182427:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98b4049d8000) 00000020:00000080:0.0:1784584060.182446:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1784584060.182462:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784584060.182570:0:17922:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784584060.182577:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48b5e 00000020:00000080:0.0:1784584060.182761:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784584060.182765:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.182769:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.182771:0:17922:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784584060.182780:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.182784:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.182785:0:17922:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784584060.182788:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584060.182795:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98b4049d99c0) 00000020:00000080:0.0:1784584060.186731:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1784584060.186751:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784584060.186753:0:17922:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784584060.186756:0:17922:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784584060.186763:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784584060.186950:0:17922:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b437661000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784584060.186978:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98b4340899c0) 00000020:00000080:0.0:1784584060.186989:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1784584060.187058:0:17922:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784584060.187066:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48b73 00000020:00000080:0.0:1784584060.187206:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784584060.187214:0:17922:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784584060.187219:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdab2421a42e48b7a 00080000:01000000:0.0:1784584060.187225:0:17922:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784584060.187229:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48b81 00010000:00010000:2.0:1784584060.291884:0:17922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1784584060.295125:0:17922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1784584060.296061:0:17922:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784584060.302626:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1784584060.302641:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.302649:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.302651:0:17922:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1784584060.302654:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.302659:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.302661:0:17922:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1784584060.302664:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584060.302669:0:17922:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:0.0:1784584060.302698:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584060.302713:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98b434088000) 00000020:00000080:0.0:1784584060.302735:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1784584060.302739:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784584060.302890:0:17922:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1784584060.302897:0:17922:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784584060.302904:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48b8f 00010000:00080000:0.0:1784584060.303099:0:17922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b30376b000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784584060.308447:0:17922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1784584060.311330:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784584060.311345:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784584060.311383:0:17922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784584060.311405:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48b96 00000100:00080000:0.0:1784584060.311415:0:17922:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584060.311420:0:17922:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b30376b000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584060.311496:0:17922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef18000 x1871271599181568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584060.311514:0:17922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784584060.311550:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599181568:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1784584060.311567:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.311573:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311575:0:17922:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1784584060.311578:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584060.311581:0:17922:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784584060.311583:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584060.311584:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584060.311586:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584060.311590:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311592:0:17922:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584060.311594:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.311600:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311602:0:17922:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1784584060.311606:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784584060.311621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:0.0:1784584060.311638:0:17922:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784584060.311657:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.311661:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311669:0:17922:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1784584060.311674:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584060.311676:0:17922:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1784584060.311678:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584060.311679:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584060.311681:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584060.311684:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311685:0:17922:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000100:00100000:2.0:1784584060.311687:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181568 00000020:01000000:0.0:1784584060.311689:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584060.311694:0:17922:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000100:00100000:2.0:1784584060.311696:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181568 00000020:00000080:0.0:1784584060.311697:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.311700:0:17922:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784584060.311705:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584060.311709:0:17922:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:0.0:1784584060.311733:0:17922:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000100:00100000:2.0:1784584060.311734:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:0.0:1784584060.311737:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:2.0:1784584060.311744:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599181568:12345-0@lo:38:llog_process_th.0 00000020:00000080:0.0:1784584060.311751:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98b43408b380) 00010000:00080000:2.0:1784584060.311769:0:17192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1784584060.311778:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784584060.311786:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:2.0:1784584060.311823:0:17192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48ba4 00000004:00100000:2.0:1784584060.311838:0:17192:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784584060.311843:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1784584060.311987:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784584060.311993:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784584060.311995:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584060.312000:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1784584060.312004:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784584060.312009:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b43cb02000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584060.312036:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303961180 x1871271599181696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584060.312053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584060.312056:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584060.312059:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584060.312061:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584060.312093:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584060.312102:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599181824:0@lo:400:kworker.0 00000100:00100000:1.0:1784584060.312133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784584060.320836:0:17922:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784584060.320848:0:17922:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784584060.320863:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48bab 00010000:00080000:0.0:1784584060.320904:0:17922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43ed10000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.151@tcp at head 00000100:00100000:1.0:1784584060.320953:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181824 00000100:00100000:1.0:1784584060.320962:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181824 00010000:00010000:0.0:1784584060.321137:0:17922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1784584060.323437:0:17922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584060.323652:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1784584060.324671:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584060.324696:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599181824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584060.324788:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599181824:12345-0@lo:400:kworker.0 Request processed in 102us (12654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.324797:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784584060.324941:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b303963b80 x1871271599181824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584060.324957:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599181824:0@lo:400:kworker.0 00000100:00100000:1.0:1784584060.325104:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599181696:0@lo:38:kworker.0 00000100:00100000:1.0:1784584060.325144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1784584060.325172:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584060.325181:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1784584060.325188:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1784584060.325288:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599181696 00000100:00100000:1.0:1784584060.325294:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599181696 00000100:00100000:1.0:1784584060.325390:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584060.325395:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1871271599181696:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784584060.325444:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1871271599181696:12345-0@lo:38:kworker.0 Request processed in 46us (299us total) trans 0 rc -11/-11 00000040:00080000:0.0:1784584060.325620:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:1.0:1784584060.325731:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584060.325758:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000040:00080000:0.0:1784584060.325758:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1784584060.325764:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584060.325768:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784584060.325771:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599181696:0@lo:38:kworker.0 00000040:00080000:1.0:1784584060.328285:0:17928:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584060.328293:0:17928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784584060.329362:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784584060.329375:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784584060.329416:0:17922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784584060.329438:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48bb2 00000100:00080000:2.0:1784584060.329448:0:17922:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584060.329463:0:17922:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43ed10000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584060.329570:0:17922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b40921ad80 x1871271599181952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584060.329601:0:17922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784584060.329695:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584060.329699:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584060.329701:0:17922:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784584060.329704:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784584060.329707:0:17922:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1784584060.329709:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584060.329710:0:17922:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584060.329712:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784584060.329714:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584060.329716:0:17922:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784584060.329718:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784584060.329723:0:17922:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784584060.329726:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584060.329728:0:17922:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784584060.329731:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784584060.329734:0:17922:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:2.0:1784584060.329760:0:17922:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784584060.329763:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584060.329775:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98b4071a99c0) 00000020:00000080:2.0:1784584060.329787:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1784584060.329792:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784584060.329848:0:17922:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1784584060.329856:0:17922:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784584060.329861:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e48bc0 00010000:00080000:2.0:1784584060.329890:0:17922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302bd1800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584060.330086:0:17922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1784584060.330150:0:17922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784584060.330164:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1784584060.330437:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599181952:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784584060.330514:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599181952 offset 0 length 520: 4 00000100:00080000:0.0:1784584060.331937:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584060.331946:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584060.331948:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584060.331959:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584060.334342:0:17192:0:(import.c:65:import_set_state_nolock()) ffff98b43ed16800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584060.334442:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599181568:12345-0@lo:38:llog_process_th.0 Request processed in 22696us (22819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.334503:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584060.334538:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584060.334547:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1784584060.334555:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784584060.334561:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784584060.334563:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784584060.334583:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599181568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584060.334871:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584060.334886:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599182080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584060.334923:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.334998:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182080 00000100:00100000:1.0:1784584060.335006:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182080 00000100:00100000:1.0:1784584060.335063:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584060.335072:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599182080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784584060.335098:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784584060.335146:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599182080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.335152:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584060.335198:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599182080:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784584060.337698:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584060.338525:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784584060.338664:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784584060.340415:0:17930:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784584060.340422:0:17930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784584060.344008:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784584060.344033:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584060.344072:0:17922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784584060.344094:0:17922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48bc7 00000100:00080000:0.0:1784584060.344105:0:17922:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584060.344112:0:17922:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584060.344150:0:17922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef1a680 x1871271599182208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584060.344178:0:17922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784584060.344237:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.344241:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.344243:0:17922:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784584060.344245:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.344249:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.344250:0:17922:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584060.344253:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584060.344255:0:17922:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784584060.344257:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.344259:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.344260:0:17922:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784584060.344262:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.344264:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.344266:0:17922:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784584060.344269:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784584060.344310:0:17922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.344313:0:17922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.344314:0:17922:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784584060.344318:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1784584060.344591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584060.344604:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584060.344607:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584060.344609:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584060.344678:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599182208:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784584060.344728:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599182208 offset 0 length 520: 4 00000020:01000000:3.0:1784584060.344786:0:17918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1784584060.344814:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784584060.344826:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.344837:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584060.344844:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b437661000 from 1 10000000:01000000:3.0:1784584060.344847:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584060.344872:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.344880:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.344901:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.344917:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584060.344950:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.344977:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.345042:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182336 00000100:00100000:1.0:1784584060.345048:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182336 00000100:00100000:1.0:1784584060.345601:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784584060.345612:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+15:17918:x1871271599182336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.345625:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584060.345638:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48bce expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.345661:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48bce expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.345672:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48bce expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.345681:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172ce200, rc 0) 00000100:00100000:1.0:1784584060.345725:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17918:x1871271599182336:12345-0@lo:101:mount.lustre.0 Request processed in 116us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.345732:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584060.346113:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584060.346129:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.346139:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584060.346736:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182464:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784584060.346783:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.347008:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4051460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.348401:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182464 00000100:00100000:2.0:1784584060.348413:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182464 00000100:00100000:2.0:1784584060.348634:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584060.348644:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17918:x1871271599182464:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784584060.348666:0:17181:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784584060.348688:0:17181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784584060.348691:0:17181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1784584060.348817:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17918:x1871271599182464:12345-0@lo:256:mount.lustre.0 Request processed in 173us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.348825:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784584060.348917:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182464:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784584060.349575:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584060.349592:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.349603:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584060.349610:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b437661000 from 1 10000000:01000000:0.0:1784584060.349613:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584060.349640:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.349647:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.349709:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584060.349732:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584060.349773:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.349798:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4051460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.350008:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182592 00000100:00100000:2.0:1784584060.350014:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182592 00000100:00100000:2.0:1784584060.350060:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584060.350066:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17918:x1871271599182592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584060.350075:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584060.350088:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48bdc expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.350106:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.350117:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.350125:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0200, rc 0) 00000100:00100000:2.0:1784584060.350162:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182592:12345-0@lo:101:mount.lustre.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.350177:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784584060.350426:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584060.350441:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.350460:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584060.350614:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584060.350643:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584060.350670:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.350697:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405146600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.350878:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182720 00000100:00100000:2.0:1784584060.350882:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182720 00000100:00100000:2.0:1784584060.350906:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784584060.350912:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584060.350995:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182720:12345-0@lo:501:mount.lustre.0 Request processed in 82us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.351002:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584060.351143:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584060.351168:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584060.351207:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.351229:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405146600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.353168:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182848 00000100:00100000:1.0:1784584060.353182:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182848 00000100:00100000:1.0:1784584060.353229:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784584060.353238:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584060.353375:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182848:12345-0@lo:503:mount.lustre.0 Request processed in 138us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.353392:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784584060.353737:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784584060.354283:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584060.354363:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584060.354423:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.354553:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4051460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.357252:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599182976 00000100:00100000:1.0:1784584060.357267:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599182976 00000100:00100000:1.0:1784584060.357331:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784584060.357341:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584060.357877:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599182976:12345-0@lo:502:mount.lustre.0 Request processed in 536us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.357886:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784584060.358033:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599182976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584060.358256:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784584060.358287:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1784584060.358300:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1784584060.358315:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1784584060.358344:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1784584060.358360:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1784584060.358373:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1784584060.358386:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1784584060.358399:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784584060.358410:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1784584060.358422:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1784584060.358489:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584060.358537:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.358785:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4051460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.358871:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183104 00000100:00100000:2.0:1784584060.358878:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183104 00000100:00100000:2.0:1784584060.358970:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584060.358980:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599183104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584060.359096:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599183104:12345-0@lo:502:mount.lustre.0 Request processed in 118us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.359103:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584060.359170:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584060.359217:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1784584060.359226:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784584060.363002:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.363016:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363028:0:17932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584060.363039:0:17932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b437661000 00000020:00000080:0.0:1784584060.363042:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584060.363050:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.363053:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363054:0:17932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784584060.363057:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.363073:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363074:0:17932:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784584060.363079:0:17932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b437661000 00000020:00000080:0.0:1784584060.363081:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584060.363143:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.363147:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363148:0:17932:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784584060.363151:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.363154:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363155:0:17932:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584060.363159:0:17932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b437661000 00000020:00000080:0.0:1784584060.363161:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584060.363180:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.363183:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363184:0:17932:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584060.363187:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584060.363189:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363191:0:17932:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784584060.363194:0:17932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b437661000 00000020:00000080:0.0:1784584060.363196:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584060.363218:0:17932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584060.363221:0:17932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584060.363223:0:17932:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784584060.363226:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1784584060.371686:0:17918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784584060.371729:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584060.371748:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.371758:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584060.371824:0:17918:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784584060.371827:0:17918:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b437661000 10000000:01000000:1.0:1784584060.371830:0:17918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b437661000 10000000:01000000:1.0:1784584060.371834:0:17918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584060.371839:0:17918:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b437661000 from 1 10000000:01000000:1.0:1784584060.371842:0:17918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584060.371878:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.371886:0:17918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.371897:0:17918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584060.371930:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584060.371994:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.372038:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.372061:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183232 00000100:00100000:1.0:1784584060.372067:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183232 00000100:00100000:1.0:1784584060.372109:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784584060.372118:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17918:x1871271599183232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.372130:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584060.372143:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cfa00/0xdab2421a42e48bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48bea expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.372165:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cfa00/0xdab2421a42e48bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48bea expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.372175:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cfa00/0xdab2421a42e48bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48bea expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.372184:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cfa00, rc 0) 00000100:00100000:1.0:1784584060.372218:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183232:12345-0@lo:101:mount.lustre.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.372223:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784584060.372274:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584060.372289:0:17918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584060.372297:0:17918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584060.383773:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784584060.384128:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584060.384318:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784584060.384345:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1784584060.384363:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1784584060.384379:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1784584060.384393:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1784584060.384407:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1784584060.384419:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1784584060.384430:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1784584060.384441:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1784584060.384464:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1784584060.395539:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1784584060.395572:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1784584060.395589:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1784584060.395604:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1784584060.395633:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1784584060.395649:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1784584060.395661:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1784584060.395673:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1784584060.395688:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1784584060.395703:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1784584060.395720:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1784584060.395737:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1784584060.395752:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1784584060.395772:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1784584060.395787:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1784584060.395991:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1784584060.396011:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1784584060.396039:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1784584060.396071:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1784584060.396077:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1784584060.396184:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584060.396249:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.396359:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04900 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.398233:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183360 00000100:00100000:2.0:1784584060.398252:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183360 00000100:00100000:1.0:1784584060.403164:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584060.403177:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584060.403347:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183360:12345-0@lo:501:mount.lustre.0 Request processed in 172us (7098us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.403355:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584060.403420:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584060.403507:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584060.403552:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.403589:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584060.403612:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183488 00000100:00100000:3.0:1784584060.403619:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183488 00000100:00100000:3.0:1784584060.403659:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584060.403669:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584060.403766:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183488:12345-0@lo:503:mount.lustre.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584060.403775:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584060.403787:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584060.404188:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584060.404261:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584060.404297:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.404320:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183616 00000100:00100000:1.0:1784584060.404324:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183616 00000100:00100000:1.0:1784584060.404358:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784584060.404365:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584060.404436:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183616:12345-0@lo:502:mount.lustre.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.404443:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784584060.404524:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584060.404539:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584060.404738:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1784584060.404764:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1784584060.404778:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1784584060.404790:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1784584060.404801:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1784584060.404815:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1784584060.404827:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1784584060.404840:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1784584060.404852:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1784584060.404864:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1784584060.404890:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1784584060.404903:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1784584060.404915:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1784584060.404927:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1784584060.404938:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1784584060.404965:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1784584060.404981:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1784584060.404994:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1784584060.405007:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1784584060.405021:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1784584060.405034:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1784584060.405046:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1784584060.405058:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1784584060.405069:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1784584060.405081:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1784584060.405093:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1784584060.405104:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1784584060.405117:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1784584060.405129:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1784584060.405142:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1784584060.405155:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1784584060.405182:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1784584060.405199:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1784584060.405212:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1784584060.405225:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1784584060.405236:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1784584060.405248:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1784584060.405261:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1784584060.405275:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1784584060.405288:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1784584060.405299:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1784584060.405310:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1784584060.405321:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1784584060.405346:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1784584060.405361:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1784584060.405373:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1784584060.405384:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1784584060.405410:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1784584060.405448:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584060.405530:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.405555:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584060.405569:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183744 00000100:00100000:3.0:1784584060.405576:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183744 00000100:00100000:3.0:1784584060.405615:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784584060.405622:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584060.405714:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183744:12345-0@lo:502:mount.lustre.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584060.405722:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584060.408593:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584060.408895:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1784584060.408924:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1784584060.408961:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584060.409660:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.409708:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584060.409781:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599183872 00000100:00100000:3.0:1784584060.409799:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599183872 00000100:00100000:3.0:1784584060.409849:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784584060.409857:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584060.410048:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599183872:12345-0@lo:502:mount.lustre.0 Request processed in 190us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584060.410062:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784584060.410072:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599183872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584060.410130:0:17918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1784584060.410140:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784584060.413036:0:17938:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1784584060.413055:0:17938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98b42e930000) 00000020:00000080:3.0:1784584060.413077:0:17938:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1784584060.413703:0:17938:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b437661000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784584060.413707:0:17938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b437661000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784584060.413710:0:17938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b437661000 3 00010000:00080000:3.0:1784584060.413748:0:17938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b405f4e000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784584060.418329:0:17938:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1784584060.418438:0:17938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1784584060.418536:0:17938:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584060.418550:0:17938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdab2421a42e48bff 00000100:00080000:3.0:1784584060.418561:0:17938:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584060.418567:0:17938:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98b405f4e000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584060.418602:0:17938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b3048a7480 x1871271599184000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584060.418629:0:17938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784584060.418657:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584060.418661:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584060.418665:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584060.418668:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584060.421718:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599184000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784584060.421814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.421899:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184000 00000100:00100000:0.0:1784584060.421906:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184000 00000100:00100000:0.0:1784584060.421940:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584060.421946:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599184000:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784584060.421973:0:17187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1784584060.422038:0:17187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdab2421a42e48c06 00000004:00100000:0.0:1784584060.422054:0:17187:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584060.422087:0:17187:0:(import.c:65:import_set_state_nolock()) ffff98b404995000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584060.422144:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1871271599184000:12345-0@lo:38:llog_process_th.0 Request processed in 196us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.422151:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784584060.425533:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b3048a7480 x1871271599184000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584060.425548:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584060.425559:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1784584060.425583:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784584060.425589:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784584060.425594:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b405f4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784584060.425601:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599184000:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784584060.428298:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1784584060.429744:0:17918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784584060.429784:0:17918:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584060.429807:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.429819:0:17918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584060.429881:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584060.429883:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584060.429884:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584060.429885:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584060.429886:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584060.429888:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584060.429889:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584060.429891:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584060.429892:0:17918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584060.429895:0:17918:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1784584060.429898:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584060.429899:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584060.429900:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584060.429901:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584060.429902:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584060.429904:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584060.429905:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584060.429906:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584060.429907:0:17918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584060.429933:0:17918:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784584060.429964:0:17918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599184128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584060.430032:0:17918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584060.430107:0:17918:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584060.430764:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184128 00000100:00100000:3.0:1784584060.430774:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184128 00000100:00100000:3.0:1784584060.430862:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784584060.430871:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599184128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784584060.430898:0:17181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784584060.430910:0:17181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1784584060.432168:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1784584060.432246:0:17181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784584060.432257:0:17181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784584060.432377:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584060.432383:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584060.432402:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432420:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432428:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48bce expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432436:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432579:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432592:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 18 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.432615:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599184256:0@lo:104: 00000100:00100000:3.0:1784584060.432670:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584060.432732:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.432740:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 18 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.432748:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599184384:0@lo:104: 00000100:00100000:3.0:1784584060.432769:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.432789:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.433041:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184256 00000100:00100000:2.0:1784584060.433053:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184256 00000100:00100000:2.0:1784584060.433083:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184384 00000100:00100000:2.0:1784584060.433085:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184384 00000100:00100000:2.0:1784584060.433100:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584060.433107:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599184256:12345-0@lo:104: 00010000:00010000:2.0:1784584060.433120:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.433406:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584060.433413:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599184256:12345-0@lo:104: Request processed in 306us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.433421:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584060.433441:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584060.433459:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599184256:0@lo:104: 00000100:00100000:2.0:1784584060.433459:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599184384:12345-0@lo:104: 00010000:00010000:2.0:1784584060.433495:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584060.433539:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784584060.433544:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599184384:12345-0@lo:104: Request processed in 97us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.433549:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584060.433602:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17918:x1871271599184128:12345-0@lo:253:mount.lustre.0 Request processed in 2732us (3569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.433610:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584060.433653:0:17918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17918:1871271599184128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584060.433665:0:17918:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784584060.433668:0:17918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584060.433670:0:17918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584060.433678:0:17918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584060.433679:0:17918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584060.433680:0:17918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584060.433681:0:17918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584060.433683:0:17918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584060.433685:0:17918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584060.433686:0:17918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584060.433698:0:17918:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784584060.434133:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584060.434140:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434148:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584060.434152:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434161:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584060.434168:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584060.434174:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584060.434210:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434222:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584060.434243:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434250:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97200/0xdab2421a42e48bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48bd5 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434262:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584060.434265:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434271:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584060.434274:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434281:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584060.434288:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584060.434293:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584060.434308:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434314:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584060.434329:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434336:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9000/0xdab2421a42e48b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48b11 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434355:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584060.434357:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584060.434358:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584060.434371:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599184512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584060.434404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.434459:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599184640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584060.434500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584060.434529:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184512 00000100:00100000:3.0:1784584060.434534:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184512 00010000:00010000:3.0:1784584060.434555:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 18 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.434576:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184640 00000100:00100000:3.0:1784584060.434579:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184640 00010000:00010000:3.0:1784584060.434589:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 19 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.434600:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584060.434606:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:3642:x1871271599184512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584060.434616:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584060.434621:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 19 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434630:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 19 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434642:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce200/0xdab2421a42e48bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48bce expref: 19 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434665:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584060.434697:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3642:x1871271599184512:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584060.434704:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584060.434716:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584060.434722:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:3639:x1871271599184640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584060.434729:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584060.434733:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 17 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434741:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 17 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434753:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434760:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584060.434773:0:17171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006922807s 00010000:00010000:3.0:1784584060.434778:0:17171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434785:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434793:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434816:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434821:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584060.434826:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434833:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434842:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434852:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584060.434883:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:3639:x1871271599184640:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584060.434890:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584060.434919:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599184640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584060.434938:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599184512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584060.434956:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48b0a expref: 16 pid: 17180 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584060.434966:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599184384:0@lo:104: 00010000:00010000:3.0:1784584060.434978:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434986:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.434998:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584060.435005:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584060.439594:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784584060.455658:0:17918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1784584060.456013:0:17944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1784584060.456437:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1784584060.457917:0:17918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:0.0:1784584060.459354:0:17943:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1784584060.459361:0:17943:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784584060.459703:0:17945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599184768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784584060.459777:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.459971:0:17945:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04540 going to sleep for 11 seconds 00000040:01000000:3.0:1784584060.460029:0:17918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1784584060.460067:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784584060.460499:0:17918:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784584060.460506:0:17918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1784584060.460539:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584060.460625:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184768 00000100:00100000:0.0:1784584060.460631:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184768 00000100:00100000:0.0:1784584060.460669:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584060.460675:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599184768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584060.460744:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599184768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.460748:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584060.460781:0:17945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599184768:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1784584060.460813:0:17945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784584060.460835:0:17945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599184896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584060.460857:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.460869:0:17945:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b409123780 going to sleep for 11 seconds 00000040:00080000:2.0:1784584060.462668:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784584060.462741:0:17944:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1784584060.462785:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599184896 00000100:00100000:2.0:1784584060.462794:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599184896 00000040:00080000:3.0:1784584060.463674:0:17918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1784584060.464161:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584060.464537:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599184896:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1784584060.465335:0:17918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784584060.465385:0:17918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1784584060.465522:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784584060.466109:0:17918:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:2.0:1784584060.466362:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599184896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2189us (5499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584060.467289:0:17945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599184896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784584060.467369:0:17945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17945:1871271599185024:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784584060.467421:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584060.467486:0:17945:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410c04a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584060.467644:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185024 00000100:00100000:0.0:1784584060.467651:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185024 00000100:00100000:0.0:1784584060.467689:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584060.467698:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1871271599185024:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1784584060.467777:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584060.467778:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1871271599185024:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584060.468237:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784584060.468273:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b303961c00 x1871271599185024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584060.468286:0:17945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17945:1871271599185024:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784584060.468334:0:17945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599185152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584060.468366:0:17945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584060.468395:0:17945:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b409123780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584060.468508:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185152 00000100:00100000:2.0:1784584060.468514:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185152 00000100:00100000:2.0:1784584060.468546:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584060.468554:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599185152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784584060.468618:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17945:x1871271599185152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584060.468624:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584060.469006:0:17945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17945:1871271599185152:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784584060.469053:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1784584060.470142:0:17918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1784584060.478888:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784584060.478977:0:17945:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784584060.478983:0:17945:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1784584060.482659:0:17918:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784584060.482715:0:17918:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb9d4191b988 00100000:10000000:1.0:1784584060.482722:0:17918:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1784584060.483533:0:17918:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784584060.483569:0:17918:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784584060.483589:0:17918:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784584060.483604:0:17918:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1784584060.484375:0:17918:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584060.484611:0:17918:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584060.525800:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584060.983868:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000040:00080000:1.0:1784584061.487558:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784584061.550062:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584061.933659:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584061.933667:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b437661000 from 8 10000000:01000000:1.0:1784584061.933673:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584061.933721:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584061.933734:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584061.933745:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584061.933771:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584061.933841:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584061.933903:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584061.934029:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185280 00000100:00100000:3.0:1784584061.934036:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185280 00000100:00100000:3.0:1784584061.934092:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784584061.934102:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17184:x1871271599185280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584061.934115:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584061.934127:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c14 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584061.934149:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 17 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584061.934160:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 17 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584061.934193:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784584061.934255:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599185280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584061.934261:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784584061.934432:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584061.934457:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.934480:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584061.934533:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784584061.934567:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584061.934593:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584061.934816:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185408 00000100:00100000:3.0:1784584061.934820:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185408 00000100:00100000:3.0:1784584061.934871:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784584061.934879:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599185408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584061.934893:0:17181:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584061.934908:0:17181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584061.934911:0:17181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784584061.935007:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599185408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584061.935015:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584061.935129:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584061.935172:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584061.935179:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.935186:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584061.935195:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784584061.935197:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b3041fd000 from 8 10000000:01000000:0.0:1784584061.935199:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784584061.935216:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.935224:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.935233:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584061.935246:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784584061.935272:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584061.935299:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584061.935339:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185536 00000100:00100000:1.0:1784584061.935344:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185536 00000100:00100000:1.0:1784584061.935379:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784584061.935387:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599185536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584061.935394:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584061.935405:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c22 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584061.935431:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584061.935450:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584061.935457:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cea00, rc 0) 00000100:00100000:1.0:1784584061.935521:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599185536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584061.935527:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584061.935643:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584061.935654:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.935661:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584061.935703:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784584061.935730:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584061.935756:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302a40600 going to sleep for 11 seconds 00000100:00100000:3.0:1784584061.938604:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185664 00000100:00100000:3.0:1784584061.938619:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185664 00000100:00100000:3.0:1784584061.938672:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584061.938682:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599185664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584061.938705:0:17181:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584061.938720:0:17181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584061.938723:0:17181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784584061.938873:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599185664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584061.938881:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584061.939203:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599185664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584061.939255:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584061.939264:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584061.939276:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584062.009197:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000040:00080000:0.0:1784584062.516034:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784584062.576248:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584063.021666:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1784584063.597698:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584064.045660:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1784584064.623398:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584064.755399:0:18187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784584065.070650:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 0 seconds 00000020:00000004:3.0:1784584065.635242:0:18240:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584065.635457:0:18240:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584065.646138:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584065.710031:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599185792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584065.710092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.710182:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185792 00000100:00100000:3.0:1784584065.710189:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185792 00000100:00100000:3.0:1784584065.710234:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584065.710242:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599185792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584065.710276:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584065.710323:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599185792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.710330:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584065.710371:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599185792:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784584065.710534:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784584065.710538:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784584065.710541:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584065.710548:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b43cb02000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584065.710568:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303960000 x1871271599186048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584065.710585:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584065.710589:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584065.710591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584065.710594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584065.710606:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584065.710619:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584065.710621:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584065.710624:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584065.710657:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599186048:0@lo:38:kworker.0 00000100:00100000:1.0:1784584065.710688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584065.710726:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186048 00000100:00100000:1.0:1784584065.710731:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186048 00000100:00100000:1.0:1784584065.710748:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584065.710753:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599186048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784584065.710801:0:17191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1784584065.710835:0:17191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48c30 00000004:00100000:1.0:1784584065.710849:0:17191:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784584065.710855:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1784584065.711362:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599185920:0@lo:400:kworker.0 00000100:00100000:3.0:1784584065.711399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.711449:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584065.711455:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599186176:0@lo:400:kworker.0 00000100:00100000:3.0:1784584065.711500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.711538:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186176 00000100:00100000:3.0:1784584065.711542:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186176 00000100:00100000:3.0:1784584065.711580:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584065.711587:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584065.711632:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599186176:12345-0@lo:400:kworker.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.711638:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584065.711655:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599186304:0@lo:400:kworker.0 00000100:00100000:3.0:1784584065.711689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.711719:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186304 00000100:00100000:3.0:1784584065.711723:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186304 00000100:00100000:3.0:1784584065.711744:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584065.711751:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599186304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584065.711798:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599186304:12345-0@lo:400:kworker.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.711805:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784584065.711834:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b303962300 x1871271599186304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584065.711847:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599186304:0@lo:400:kworker.0 00010000:00080000:3.0:1784584065.711872:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b303961f80 x1871271599186176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584065.711881:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599186176:0@lo:400:kworker.0 00000100:00100000:1.0:1784584065.712117:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599185920 00000100:00100000:1.0:1784584065.712122:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599185920 00000100:00100000:1.0:1784584065.712167:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784584065.712175:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3641:x1871271599185920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584065.712209:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3641:x1871271599185920:12345-0@lo:400:kworker.0 Request processed in 36us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584065.712216:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784584065.712249:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599185920:0@lo:400:kworker.0 00000100:00080000:0.0:1784584065.721920:0:17191:0:(import.c:65:import_set_state_nolock()) ffff98b406166000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1784584065.722731:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784584065.722742:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784584065.722748:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784584065.722751:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784584065.722769:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000809fb41): req@ffff98b409219c00 x1871271599179008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584065.722787:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599186048:0@lo:38:kworker.0 00000100:00100000:0.0:1784584065.722846:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599186048:12345-0@lo:38:kworker.0 Request processed in 12088us (12153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584065.722858:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584065.723188:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.723222:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43c8e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584065.723239:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599179008 00000100:00100000:3.0:1784584065.723245:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599179008 00000100:00100000:3.0:1784584065.723304:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584065.723313:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599179008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.723388:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599179008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.723395:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584065.723410:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584065.723431:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599186432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584065.723457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.723510:0:17228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17228:1871271599179008:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784584065.723540:0:17228:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784584065.723571:0:17228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17228:1871271599186560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.723600:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.723623:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a545780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584065.723633:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186432 00000100:00100000:3.0:1784584065.723636:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186432 00000100:00100000:3.0:1784584065.723651:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186560 00000100:00100000:3.0:1784584065.723653:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186560 00000100:00100000:3.0:1784584065.723663:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584065.723668:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599186432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784584065.723689:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584065.723738:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599186432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.723744:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584065.723755:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584065.723761:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599186560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.724317:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599186560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 553us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.724331:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584065.724368:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599186432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584065.724393:0:17228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17228:1871271599186560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.724490:0:17228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17228:1871271599186688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.724524:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584065.724542:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a545780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584065.724555:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186688 00000100:00100000:3.0:1784584065.724559:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186688 00000100:00100000:3.0:1784584065.724578:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584065.724584:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599186688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584065.724636:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1871271599186688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584065.724643:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584065.724670:0:17228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17228:1871271599186688:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784584065.724723:0:17228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584065.734960:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784584065.735039:0:17228:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1784584065.735044:0:17228:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1784584066.445400:0:18291:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584066.445906:0:18291:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784584066.669688:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584067.466519:0:18339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffff1ba8d0 20000000:00000080:0.0:1784584067.466536:0:18339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b405f1a400 uarg=0000000000000000 20000000:01000000:0.0:1784584067.466576:0:18339:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1784584067.466584:0:18339:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1784584067.466588:0:18339:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1784584067.468442:0:18340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1784584067.468663:0:18339:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784584067.477260:0:18339:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784584067.477292:0:18339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477311:0:18339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 17 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477329:0:18339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477337:0:18339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477381:0:18339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477394:0:18339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 17 pid: 17181 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584067.477419:0:18339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1871271599186816:0@lo:104: 00000100:00100000:3.0:1784584067.477651:0:18339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584067.477717:0:18339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 17 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.477725:0:18339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 17 pid: 17180 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584067.477734:0:18339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1871271599186944:0@lo:104: 00000100:00100000:3.0:1784584067.477767:0:18339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584067.477791:0:18339:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584067.477882:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186816 00000100:00100000:0.0:1784584067.477889:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186816 00000100:00100000:0.0:1784584067.477922:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599186944 00000100:00100000:0.0:1784584067.477924:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599186944 00000100:00100000:0.0:1784584067.477935:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584067.477948:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:18339:x1871271599186816:12345-0@lo:104: 00010000:00010000:0.0:1784584067.477959:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478016:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584067.478021:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:18339:x1871271599186816:12345-0@lo:104: Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584067.478028:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584067.478043:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584067.478048:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:18339:x1871271599186944:12345-0@lo:104: 00010000:00010000:0.0:1784584067.478063:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478091:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784584067.478096:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:18339:x1871271599186944:12345-0@lo:104: Request processed in 48us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584067.478101:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784584067.478114:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584067.478119:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478126:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584067.478130:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478138:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584067.478146:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584067.478157:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584067.478180:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478196:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584067.478214:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478221:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48bdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48be3 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478232:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584067.478234:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478240:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584067.478243:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478250:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584067.478256:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584067.478261:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584067.478272:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478277:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584067.478290:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478297:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48ad9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ae0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478308:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584067.478310:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584067.478312:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584067.478329:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599187200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584067.478357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584067.478377:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584067.478383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599187072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584067.478402:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584067.478442:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187200 00000100:00100000:0.0:1784584067.478445:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187200 00010000:00010000:0.0:1784584067.478462:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 18 pid: 17180 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584067.478507:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187072 00000100:00100000:0.0:1784584067.478510:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187072 00010000:00010000:0.0:1784584067.478521:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 19 pid: 17181 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584067.478533:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584067.478538:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:3642:x1871271599187200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584067.478547:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584067.478552:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 19 pid: 17180 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478571:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 19 pid: 17180 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478586:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584067.478610:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:3642:x1871271599187200:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584067.478616:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584067.478627:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584067.478632:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3642:x1871271599187072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584067.478639:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584067.478642:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 18 pid: 17181 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478651:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 18 pid: 17181 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478662:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478669:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478681:0:17173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478688:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478695:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478706:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478712:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584067.478716:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478723:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478731:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584067.478739:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584067.478860:0:18339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48bdc expref: 18 pid: 17181 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584067.478870:0:18339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1871271599186816:0@lo:104: 00010000:00010000:3.0:1784584067.478878:0:18339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96e00/0xdab2421a42e48ae0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48ad9 expref: 17 pid: 17180 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584067.478895:0:18339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1871271599186944:0@lo:104: 00010000:00010000:3.0:1784584067.478911:0:18339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.478919:0:18339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.478925:0:18339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584067.478931:0:18339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c37 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584067.479961:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:3642:x1871271599187072:12345-0@lo:103:ldlm_bl.0 Request processed in 1323us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584067.479972:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784584067.480545:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584067.481362:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599187072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584067.481374:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599187200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584067.693849:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584068.720871:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584069.166424:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1784584069.485707:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584069.485716:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b437661000 from 13 10000000:01000000:1.0:1784584069.485736:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584069.485782:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584069.485794:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584069.485805:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584069.485845:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584069.485910:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584069.485953:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1784584069.486058:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187328 00000100:00100000:0.0:1784584069.486066:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187328 00000100:00100000:0.0:1784584069.486119:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784584069.486129:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+16:17184:x1871271599187328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584069.486141:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584069.486156:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c3e expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584069.486190:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584069.486200:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584069.486209:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8400, rc 0) 00000100:00100000:0.0:1784584069.486259:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584069.486267:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784584069.486344:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584069.486359:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.486368:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584069.486437:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.486464:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584069.486530:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584069.486544:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187456 00000100:00100000:3.0:1784584069.486547:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187456 00000100:00100000:3.0:1784584069.486570:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584069.486576:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.486684:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584069.486691:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584069.486718:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.486746:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.486782:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584069.486797:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584069.486820:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187584 00000100:00100000:3.0:1784584069.486823:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187584 00000100:00100000:3.0:1784584069.486840:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784584069.486846:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.486918:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584069.486925:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784584069.486960:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584069.487693:0:18446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784584069.487746:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784584069.487760:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584069.487767:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487777:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584069.487785:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584069.487787:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b3041fd000 from 13 10000000:01000000:3.0:1784584069.487798:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584069.487820:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487829:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487837:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584069.487850:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.487878:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584069.487896:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584069.487910:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187712 00000100:00100000:3.0:1784584069.487913:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187712 00000100:00100000:3.0:1784584069.487935:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784584069.487941:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+17:17184:x1871271599187712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584069.487950:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584069.487961:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c4c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487978:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 18 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487987:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 18 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.487994:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96400, rc 0) 00000100:00100000:3.0:1784584069.488024:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599187712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584069.488039:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784584069.488077:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584069.488087:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584069.488095:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584069.488133:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.488155:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584069.488169:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584069.488179:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187840 00000100:00100000:3.0:1784584069.488182:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187840 00000100:00100000:3.0:1784584069.488197:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584069.488202:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599187840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.488279:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599187840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584069.488285:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584069.488309:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.488331:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.488363:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584069.488376:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584069.488386:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599187968 00000100:00100000:3.0:1784584069.488389:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599187968 00000100:00100000:3.0:1784584069.488418:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784584069.488430:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599187968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584069.488513:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:17184:x1871271599187968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584069.488519:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784584069.488550:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599187968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784584069.498982:0:18447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784584069.499071:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784584069.499092:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584069.499104:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584069.499115:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584069.741602:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584070.771948:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584070.829672:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584070.829694:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584070.829767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584070.829831:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188096 00000100:00100000:3.0:1784584070.829838:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188096 00000100:00100000:3.0:1784584070.829903:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584070.829912:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599188096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584070.829945:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584070.829990:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599188096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584070.829997:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584070.830039:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584070.830600:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584070.830611:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599188224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584070.830643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584070.830760:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584060/real 1784584060] req@ffff98b43ef1a680 x1871271599182208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584070.830779:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43ef1a680 x1871271599182208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584070.830799:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584060/real 1784584060] req@ffff98b40921ad80 x1871271599181952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584070.830833:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b40921ad80 x1871271599181952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584070.830847:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584070.830866:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584070.830870:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599182208:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784584070.830874:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584070.830878:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584070.830881:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599181952:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784584070.831572:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188224 00000100:00100000:0.0:1784584070.831582:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188224 00000100:00100000:0.0:1784584070.831635:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584070.831645:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599188224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784584070.831681:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584070.831760:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599188224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584070.831767:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584070.831825:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599188224:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1784584070.832379:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584070.832394:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584070.832396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584070.832399:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584070.832412:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584070.832425:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784584070.832441:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584070.832446:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:3.0:1784584070.832451:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784584070.832456:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43ed10000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584070.832502:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b42f7cc380 x1871271599188608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584070.832521:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584070.832524:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784584070.832526:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584070.832529:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:3.0:1784584070.832532:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784584070.832535:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584070.832547:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b42f7ced80 x1871271599188736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584070.832695:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599188608:0@lo:8:kworker.0 00000400:00000100:3.0:1784584070.832733:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599188608 offset 0 length 520: 4 00000100:00100000:3.0:1784584070.832772:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599188736:0@lo:8:kworker.0 00000100:00100000:2.0:1784584070.833222:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599188352:0@lo:400:kworker.0 00000100:00100000:2.0:1784584070.833259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584070.833280:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584070.833285:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599188480:0@lo:400:kworker.0 00000100:00100000:2.0:1784584070.833305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584070.833698:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188352 00000100:00100000:2.0:1784584070.833707:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188352 00000100:00100000:2.0:1784584070.833754:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584070.833762:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3641:x1871271599188352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584070.833819:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3641:x1871271599188352:12345-0@lo:400:kworker.0 Request processed in 57us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584070.833826:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584070.833878:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599188352:0@lo:400:kworker.0 00000100:00100000:2.0:1784584070.834103:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584070.834114:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599188864:0@lo:400:kworker.0 00000100:00100000:2.0:1784584070.834146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1784584070.834686:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599188736 offset 0 length 520: 4 00000100:00100000:3.0:1784584070.835073:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188480 00000100:00100000:3.0:1784584070.835079:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188480 00000100:00100000:1.0:1784584070.836065:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188864 00000100:00100000:1.0:1784584070.836074:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188864 00000100:00100000:1.0:1784584070.836118:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584070.836129:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599188864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584070.836205:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599188864:12345-0@lo:400:kworker.0 Request processed in 79us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584070.836212:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784584070.836453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b42f7cc700 x1871271599188864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584070.836492:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599188864:0@lo:400:kworker.0 00000100:00100000:3.0:1784584070.836662:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584070.836672:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599188480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584070.836719:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599188480:12345-0@lo:400:kworker.0 Request processed in 50us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584070.836725:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784584070.837240:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b42f7cce00 x1871271599188480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584070.837252:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599188480:0@lo:400:kworker.0 00010000:00010000:1.0:1784584071.792886:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584071.857564:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1784584072.750121:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584072.813653:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584072.877632:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584057/real 1784584057] req@ffff98b3048a6300 x1871271599180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584072.877662:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a6300 x1871271599180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584072.877672:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584057/real 1784584057] req@ffff98b3048a6680 x1871271599180160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584072.877684:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b3048a6680 x1871271599180160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784584072.877704:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584072.877738:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584072.877742:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599180032:0@lo:8:kworker.0 00000100:00080000:2.0:1784584072.877748:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584072.877754:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584072.877757:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599180160:0@lo:8:kworker.0 00000100:00080000:1.0:1784584072.877972:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584072.877976:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784584072.877979:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584072.877984:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1784584072.877990:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784584072.877997:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b43cb07800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584072.878017:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303963480 x1871271599189248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584072.878042:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584072.878045:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784584072.878047:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584072.878050:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1784584072.878053:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784584072.878056:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b43e8cb800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584072.878070:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b303961500 x1871271599189376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584072.878095:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584072.878098:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584072.878101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584072.878104:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584072.878128:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599189632:0@lo:400:kworker.0 00000100:00100000:3.0:1784584072.878163:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599189120:0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.878196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584072.878232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584072.878237:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784584072.878246:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599188992:0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.878283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584072.878288:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584072.878298:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599189504:0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.878316:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599189760:0@lo:400:kworker.0 00000100:00100000:3.0:1784584072.878331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584072.878349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584072.878387:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599189632 00000100:00100000:3.0:1784584072.878395:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599189632 00000100:00100000:1.0:1784584072.878403:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599189120 00000100:00100000:1.0:1784584072.878410:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599189120 00000100:00100000:3.0:1784584072.878447:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584072.878458:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599189632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.878460:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584072.878499:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599189120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.878552:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599189120:12345-0@lo:400:kworker.0 Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584072.878560:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584072.878581:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599188992 00000100:00100000:1.0:1784584072.878584:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599188992 00000100:00100000:1.0:1784584072.878611:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784584072.878620:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3639:x1871271599188992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584072.878636:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599189632:12345-0@lo:400:kworker.0 Request processed in 178us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584072.878644:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584072.878658:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:3639:x1871271599188992:12345-0@lo:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584072.878667:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584072.878670:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599189504 00000100:00100000:3.0:1784584072.878676:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599189504 00000100:00100000:3.0:1784584072.878706:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599189760 00000100:00100000:3.0:1784584072.878782:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599189760 00000100:00100000:1.0:1784584072.880187:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584072.880204:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599189504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.880272:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599189504:12345-0@lo:400:kworker.0 Request processed in 76us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584072.880279:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584072.880298:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584072.880303:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599189760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.880328:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599189760:12345-0@lo:400:kworker.0 Request processed in 26us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584072.880334:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584072.880379:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599189248:0@lo:8:kworker.0 00000400:00000100:1.0:1784584072.880406:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599189248 offset 0 length 520: 4 00000100:00100000:1.0:1784584072.884827:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599189376:0@lo:8:kworker.0 00000400:00000100:1.0:1784584072.884891:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599189376 offset 0 length 520: 4 00010000:00080000:1.0:1784584072.884986:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b303963100 x1871271599189504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584072.885016:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599189504:0@lo:400:kworker.0 00000100:00100000:1.0:1784584072.885030:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599189120:0@lo:400:kworker.0 00000100:00100000:2.0:1784584072.887664:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599188992:0@lo:400:kworker.0 00010000:00080000:2.0:1784584072.887688:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b303961f80 x1871271599189760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584072.887701:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599189760:0@lo:400:kworker.0 00000100:00100000:2.0:1784584072.887714:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599189632:0@lo:400:kworker.0 00000020:01000004:3.0:1784584073.438643:0:18687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784584073.438647:0:18687:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784584073.438649:0:18687:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784584073.438847:0:18687:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b405f4d000 00000020:01000004:3.0:1784584073.438862:0:18687:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784584073.438942:0:18687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784584073.438959:0:18687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98b42e934d40) 00000020:00000080:3.0:1784584073.438976:0:18687:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784584073.541788:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784584073.547518:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784584073.547842:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784584073.548082:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784584073.548824:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784584073.549045:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784584073.552598:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1784584073.553721:0:18687:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784584073.553923:0:18687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784584073.553936:0:18687:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784584073.553947:0:18687:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e48c61 00000020:01000004:2.0:1784584073.553954:0:18687:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784584073.553976:0:18687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784584073.553979:0:18687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784584073.553985:0:18687:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784584073.553989:0:18687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784584073.554002:0:18687:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98b4071ab380) 00000020:00000080:2.0:1784584073.554018:0:18687:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1784584073.559018:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584073.559203:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584073.559210:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784584073.565738:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584073.565758:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784584073.583762:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784584073.583775:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784584073.585132:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584073.585291:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784584073.585297:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784584073.587337:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784584073.587350:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784584073.629023:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584073.636621:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584073.636632:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784584073.640220:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584073.640234:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784584073.641102:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784584073.641111:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784584073.651020:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584073.651188:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784584073.651199:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784584073.656020:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784584073.656036:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784584073.743588:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584073.743899:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784584073.743905:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784584073.750448:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784584073.750465:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784584073.760589:0:18687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784584073.760639:0:18687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784584073.760646:0:18687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784584073.798811:0:18687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784584073.798860:0:18687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784584073.798865:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784584073.798867:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784584073.798868:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584073.798869:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584073.798871:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584073.798872:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584073.798874:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584073.798875:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584073.798877:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784584073.798880:0:18687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784584073.798883:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584073.798884:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784584073.798886:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584073.798887:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584073.798888:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584073.798889:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584073.798890:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584073.798891:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584073.798892:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784584073.798923:0:18687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784584073.798946:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599189888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584073.799032:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584073.799134:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b409123540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584073.801571:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599189888 00000100:00100000:0.0:1784584073.801587:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599189888 00000100:00100000:0.0:1784584073.801648:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784584073.801659:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:18687:x1871271599189888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584073.802946:0:17179:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784584073.802956:0:17179:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784584073.802961:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784584073.803320:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:18687:x1871271599189888:12345-0@lo:253:mount.lustre.0 Request processed in 1660us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584073.803332:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784584073.803917:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599189888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584073.803931:0:18687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784584073.803935:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584073.803937:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784584073.803938:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584073.803940:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584073.803941:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584073.803943:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584073.803953:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584073.803955:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584073.803956:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784584073.803976:0:18687:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b405f4d000 from lustre-OST0000 10000000:01000000:2.0:1784584073.804003:0:18687:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784584073.804006:0:18687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784584073.804014:0:18687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302a499c0 local copy 00010000:00010000:2.0:1784584073.804025:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584073.804127:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584073.804168:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584073.804199:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b409123b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.805159:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190016 00000100:00100000:1.0:1784584073.805169:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190016 00000100:00100000:1.0:1784584073.805221:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784584073.805229:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:18687:x1871271599190016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.805337:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:18687:x1871271599190016:12345-0@lo:501:mount.lustre.0 Request processed in 108us (1168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584073.805345:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784584073.807632:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190016:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784584073.807664:0:18687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784584073.807714:0:18687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784584073.807724:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.807747:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584073.807835:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b405f4d000 10000000:01000000:3.0:1784584073.807840:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784584073.807846:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784584073.807849:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584073.807853:0:18687:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784584073.807856:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784584073.807887:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.807895:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.807905:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.807924:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584073.808002:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.808049:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584073.808417:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190144 00000100:00100000:2.0:1784584073.808425:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190144 00000100:00100000:2.0:1784584073.808499:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784584073.808509:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+18:18687:x1871271599190144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584073.808524:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584073.808539:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c1000/0xdab2421a42e48c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c6f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.808563:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c1000/0xdab2421a42e48c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c6f expref: 19 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.808573:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c1000/0xdab2421a42e48c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c6f expref: 19 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.808581:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1000, rc 0) 00000100:00100000:2.0:1784584073.808621:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190144:12345-0@lo:101:mount.lustre.0 Request processed in 113us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584073.808637:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784584073.808860:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584073.808874:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.808884:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584073.810010:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784584073.810569:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584073.816080:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784584073.816144:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784584073.816159:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784584073.816172:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784584073.816204:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784584073.816220:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784584073.816246:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784584073.816252:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784584073.816381:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584073.816452:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.817292:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.817526:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190272 00000100:00100000:1.0:1784584073.817533:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190272 00000100:00100000:1.0:1784584073.817581:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784584073.817590:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.817993:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190272:12345-0@lo:501:mount.lustre.0 Request processed in 401us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.818001:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784584073.820420:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584073.820510:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584073.820600:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.820653:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.820830:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190400 00000100:00100000:1.0:1784584073.820837:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190400 00000100:00100000:1.0:1784584073.820894:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784584073.820903:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584073.821653:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190400:12345-0@lo:503:mount.lustre.0 Request processed in 748us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.821665:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784584073.821821:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584073.822258:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584073.822334:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584073.822402:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.822514:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584073.827145:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190528 00000100:00100000:0.0:1784584073.827162:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190528 00000100:00100000:0.0:1784584073.827273:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784584073.827285:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584073.828043:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190528:12345-0@lo:502:mount.lustre.0 Request processed in 758us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584073.828053:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784584073.830903:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584073.831296:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784584073.831329:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784584073.831345:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784584073.831360:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784584073.831387:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784584073.831399:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784584073.831412:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784584073.831424:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784584073.831443:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1784584073.831459:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1784584073.831510:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1784584073.831525:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1784584073.831565:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584073.831636:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584073.831676:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b409123600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.831934:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190656 00000100:00100000:1.0:1784584073.831940:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190656 00000100:00100000:1.0:1784584073.831992:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784584073.832002:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.832125:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190656:12345-0@lo:502:mount.lustre.0 Request processed in 124us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.832133:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784584073.832222:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584073.832268:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784584073.832277:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00010000:00010000:1.0:1784584073.837799:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784584073.845614:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584073.845627:0:18704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1784584073.845644:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584073.845647:0:18704:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784584073.845654:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584073.845675:0:18704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98b4331e3380) 00000020:00000080:1.0:1784584073.845701:0:18704:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784584073.845720:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784584073.845815:0:18704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f4d000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784584073.845824:0:18704:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784584073.845832:0:18704:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e48c84 00010000:00010000:0.0:1784584073.850003:0:18704:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1784584073.850455:0:18704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1784584073.851949:0:18704:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1784584073.853334:0:18704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784584073.853346:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584073.853352:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853353:0:18704:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784584073.853357:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784584073.853359:0:18704:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1784584073.853360:0:18704:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784584073.853373:0:18704:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784584073.853375:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784584073.853378:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853379:0:18704:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784584073.853382:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584073.853384:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853385:0:18704:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784584073.853388:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784584073.853389:0:18704:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784584073.853391:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584073.853393:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853394:0:18704:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784584073.853396:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584073.853398:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853399:0:18704:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784584073.853402:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784584073.853425:0:18704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584073.853427:0:18704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584073.853428:0:18704:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784584073.853440:0:18704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1784584073.853699:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1784584073.853750:0:18687:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784584073.853774:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.853799:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584073.853807:0:18687:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b405f4d000 from 1 10000000:01000000:1.0:1784584073.853811:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584073.853848:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.853856:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.853866:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584073.853891:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584073.853956:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.853999:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584073.854168:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190784 00000100:00100000:3.0:1784584073.854175:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190784 00000100:00100000:3.0:1784584073.854225:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784584073.854234:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:18687:x1871271599190784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584073.854247:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584073.854260:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c8b expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.854285:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 20 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.854296:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 20 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.854304:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97a00, rc 0) 00000100:00100000:3.0:1784584073.854361:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599190784:12345-0@lo:101:mount.lustre.0 Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.854378:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784584073.854537:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584073.854552:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.854562:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584073.855968:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784584073.856240:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584073.856463:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784584073.856679:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784584073.856872:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784584073.856884:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784584073.856955:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.857014:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.857566:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584073.857634:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599190912 00000100:00100000:2.0:1784584073.857642:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599190912 00000100:00100000:2.0:1784584073.857740:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784584073.857751:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599190912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584073.857876:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599190912:12345-0@lo:501:mount.lustre.0 Request processed in 126us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584073.857883:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784584073.858971:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599190912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.859013:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584073.859066:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.860075:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584073.860161:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191040 00000100:00100000:3.0:1784584073.860169:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191040 00000100:00100000:3.0:1784584073.860208:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784584073.860216:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584073.860348:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191040:12345-0@lo:503:mount.lustre.0 Request processed in 132us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.860356:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784584073.860456:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584073.860915:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584073.860983:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.861028:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.861047:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584073.861206:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191168 00000100:00100000:3.0:1784584073.861212:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191168 00000100:00100000:3.0:1784584073.861234:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784584073.861248:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584073.861344:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191168:12345-0@lo:502:mount.lustre.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.861351:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784584073.863963:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584073.864196:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784584073.864228:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784584073.864245:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784584073.864260:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784584073.864275:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784584073.864288:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784584073.864301:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784584073.864312:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1784584073.864323:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1784584073.864352:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1784584073.864492:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1784584073.864531:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.864600:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.864633:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584073.864722:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191296 00000100:00100000:2.0:1784584073.864728:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191296 00000100:00100000:2.0:1784584073.864772:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584073.864781:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584073.864891:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191296:12345-0@lo:502:mount.lustre.0 Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584073.864903:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784584073.865039:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584073.865082:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1784584073.865089:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784584073.868002:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584073.868014:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584073.868017:0:18708:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584073.868025:0:18708:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b405f4d000 00000020:00000080:2.0:1784584073.868028:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584073.868035:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584073.868038:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584073.868039:0:18708:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584073.868042:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584073.868044:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584073.868045:0:18708:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584073.868049:0:18708:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b405f4d000 00000020:00000080:2.0:1784584073.868051:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584073.868143:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584073.868148:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584073.868149:0:18708:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584073.868151:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584073.868154:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584073.868155:0:18708:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584073.868158:0:18708:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b405f4d000 00000020:00000080:2.0:1784584073.868160:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584073.868870:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584073.873566:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584073.873573:0:18708:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584073.873583:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584073.873589:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584073.873590:0:18708:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784584073.873595:0:18708:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b405f4d000 00000020:00000080:0.0:1784584073.873597:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584073.873666:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584073.873669:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584073.873670:0:18708:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784584073.873673:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1784584073.873839:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784584073.873870:0:18687:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584073.873891:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.873902:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584073.873949:0:18687:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784584073.873952:0:18687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b405f4d000 10000000:01000000:1.0:1784584073.873955:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b405f4d000 10000000:01000000:1.0:1784584073.873958:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584073.873962:0:18687:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b405f4d000 from 1 10000000:01000000:1.0:1784584073.873965:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584073.873998:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.874006:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.874017:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584073.874037:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584073.874103:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.874139:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584073.875444:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191424 00000100:00100000:2.0:1784584073.875458:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191424 00000100:00100000:2.0:1784584073.875676:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784584073.875687:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:18687:x1871271599191424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584073.875702:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584073.875726:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48c99 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.875764:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48c99 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.875774:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c99 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584073.875782:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0200, rc 0) 00000100:00100000:2.0:1784584073.875852:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191424:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584073.875860:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784584073.875932:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584073.875958:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584073.875967:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584073.880783:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1784584073.881076:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584073.881256:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1784584073.881278:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1784584073.881304:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1784584073.881317:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1784584073.881327:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1784584073.881336:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1784584073.881346:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1784584073.881356:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1784584073.881379:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1784584073.881391:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1784584073.881402:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1784584073.881413:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1784584073.881435:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1784584073.881449:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1784584073.881461:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1784584073.881537:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1784584073.881552:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1784584073.881565:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1784584073.881593:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1784584073.881609:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1784584073.881622:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1784584073.881633:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1784584073.881646:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1784584073.881659:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1784584073.881683:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1784584073.881697:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1784584073.881710:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1784584073.881722:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1784584073.881735:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1784584073.881748:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1784584073.881760:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1784584073.881773:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1784584073.881785:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1784584073.881796:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1784584073.881822:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1784584073.881838:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1784584073.881851:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1784584073.881871:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1784584073.881876:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1784584073.881955:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584073.882026:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.885789:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191552 00000100:00100000:1.0:1784584073.885803:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191552 00000100:00100000:1.0:1784584073.885860:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784584073.885871:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.886031:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191552:12345-0@lo:501:mount.lustre.0 Request processed in 162us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.886038:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784584073.886553:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039cf540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.886579:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584073.886625:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584073.886666:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.886689:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191680 00000100:00100000:1.0:1784584073.886693:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191680 00000100:00100000:1.0:1784584073.886723:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784584073.886730:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584073.886795:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191680:12345-0@lo:503:mount.lustre.0 Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.886801:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784584073.886831:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.886841:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584073.887189:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584073.887249:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.887283:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.887315:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191808 00000100:00100000:1.0:1784584073.887319:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191808 00000100:00100000:1.0:1784584073.887341:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784584073.887347:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.887420:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191808:12345-0@lo:502:mount.lustre.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.887437:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784584073.887463:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.887491:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584073.887619:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784584073.887641:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784584073.887652:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784584073.887662:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784584073.887673:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784584073.887683:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784584073.887693:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784584073.887703:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784584073.887714:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784584073.887727:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784584073.887741:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784584073.887754:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784584073.887767:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784584073.887779:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784584073.887791:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784584073.887804:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784584073.887816:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784584073.887828:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784584073.887856:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784584073.887870:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784584073.887881:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784584073.887904:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784584073.887916:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784584073.887927:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784584073.887938:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1784584073.887948:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1784584073.887959:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1784584073.887970:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1784584073.887984:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1784584073.887998:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1784584073.888011:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1784584073.888024:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1784584073.888038:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1784584073.888049:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1784584073.888075:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1784584073.888091:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1784584073.888104:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1784584073.888117:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1784584073.888129:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1784584073.888140:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1784584073.888151:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1784584073.888165:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1784584073.888179:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1784584073.888192:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1784584073.888204:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1784584073.888215:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1784584073.888227:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1784584073.888241:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1784584073.888276:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.888319:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.888353:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599191936 00000100:00100000:1.0:1784584073.888358:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599191936 00000100:00100000:1.0:1784584073.888406:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784584073.888420:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.888521:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599191936:12345-0@lo:502:mount.lustre.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.888528:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784584073.888564:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.888580:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599191936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584073.888716:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1784584073.888738:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1784584073.888759:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599192064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.888792:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.888813:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192064 00000100:00100000:1.0:1784584073.888816:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192064 00000100:00100000:1.0:1784584073.888834:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784584073.888840:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599192064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584073.888893:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599192064:12345-0@lo:502:mount.lustre.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.888899:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784584073.888925:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584073.888935:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599192064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584073.888963:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1784584073.888970:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784584073.893909:0:18712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784584073.893926:0:18712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98b43408cd40) 00000020:00000080:0.0:1784584073.893953:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1784584073.894129:0:18712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784584073.894133:0:18712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b405f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784584073.894136:0:18712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b405f4d000 3 00010000:00080000:0.0:1784584073.894166:0:18712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3049d7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784584073.898886:0:18712:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1784584073.898995:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784584073.899040:0:18712:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784584073.899054:0:18712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdab2421a42e48cae 00000100:00080000:0.0:1784584073.899064:0:18712:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584073.899070:0:18712:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b3049d7000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584073.899103:0:18712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef1b800 x1871271599192192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584073.899186:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599192192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584073.899252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784584073.899311:0:18712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584073.899377:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.899381:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.899384:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.899386:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.899414:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.899418:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.899421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.899432:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584073.899463:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599192704:0@lo:400:kworker.0 00000100:00100000:0.0:1784584073.899512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584073.899537:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584073.899543:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599192576:0@lo:400:kworker.0 00000100:00100000:0.0:1784584073.899569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.901533:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192192 00000100:00100000:3.0:1784584073.901550:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192192 00000100:00100000:3.0:1784584073.901590:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192704 00000100:00100000:3.0:1784584073.901594:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192704 00000100:00100000:3.0:1784584073.901624:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584073.901637:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599192704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584073.901737:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599192704:12345-0@lo:400:kworker.0 Request processed in 104us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.901745:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584073.901760:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584073.901764:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599192192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784584073.901784:0:17187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1784584073.901817:0:17187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdab2421a42e48cb5 00000004:00100000:3.0:1784584073.901833:0:17187:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784584073.901865:0:17187:0:(import.c:65:import_set_state_nolock()) ffff98b430f6e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584073.904579:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599192448:0@lo:400:kworker.0 00000100:00100000:0.0:1784584073.904653:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584073.904693:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584073.904700:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599192320:0@lo:400:kworker.0 00000100:00100000:0.0:1784584073.904739:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584073.904782:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584073.904801:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784584073.904814:0:17186:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584073.904821:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192448 00000100:00100000:0.0:1784584073.904834:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192448 00000100:00100000:0.0:1784584073.904867:0:17186:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584073.904876:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584073.904884:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599192448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584073.904933:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599192448:12345-0@lo:400:kworker.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584073.904940:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784584073.904979:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43ef1bb80 x1871271599192448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584073.904992:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599192448:0@lo:400:kworker.0 00000100:00100000:1.0:1784584073.905178:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192576 00000100:00100000:1.0:1784584073.905183:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192576 00000100:00100000:1.0:1784584073.905217:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192320 00000100:00100000:1.0:1784584073.905220:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192320 00000100:00100000:1.0:1784584073.905234:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784584073.905240:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599192576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584073.905278:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599192576:12345-0@lo:400:kworker.0 Request processed in 38us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.905285:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784584073.905297:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784584073.905302:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599192320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584073.905340:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599192320:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.905346:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584073.906572:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599192320:0@lo:400:kworker.0 00000020:01000004:0.0:1784584073.906703:0:18712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784584073.906741:0:18712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98b302440000) 00000020:00000080:0.0:1784584073.906764:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1784584073.906922:0:18712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784584073.906926:0:18712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b405f4d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784584073.906929:0:18712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b405f4d000 3 00010000:00080000:0.0:1784584073.906956:0:18712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3049d3800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784584073.908674:0:18712:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1784584073.908770:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1784584073.908810:0:18712:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784584073.908823:0:18712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdab2421a42e48cc3 00000100:00080000:0.0:1784584073.908832:0:18712:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584073.908837:0:18712:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98b3049d3800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584073.908872:0:18712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef19f80 x1871271599192832/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584073.908889:0:18712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784584073.908927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.908931:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.908934:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.908937:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.908940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.908942:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584073.908945:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584073.908948:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584073.909843:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1871271599192192:12345-0@lo:38:llog_process_th.0 Request processed in 8073us (10587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.909855:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584073.909904:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599192576:0@lo:400:kworker.0 00010000:00080000:3.0:1784584073.909920:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43ef1b480 x1871271599192704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584073.909930:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599192704:0@lo:400:kworker.0 00010000:00080000:1.0:1784584073.914571:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43ef1b800 x1871271599192192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584073.914586:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584073.914597:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784584073.914606:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784584073.914611:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784584073.914614:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3049d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784584073.914621:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599192192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584073.914824:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599192832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584073.914873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.914899:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192832 00000100:00100000:1.0:1784584073.914903:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192832 00000100:00100000:1.0:1784584073.914928:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584073.914935:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599192832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784584073.914968:0:17186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1784584073.915001:0:17186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdab2421a42e48cca 00000004:00100000:1.0:1784584073.915016:0:17186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784584073.915044:0:17186:0:(import.c:65:import_set_state_nolock()) ffff98b302b90000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584073.915086:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1871271599192832:12345-0@lo:38:llog_process_th.0 Request processed in 150us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.915094:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784584073.915136:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43ef19f80 x1871271599192832/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584073.915144:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584073.915149:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784584073.915153:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784584073.915156:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784584073.915158:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3049d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784584073.915161:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599192832:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784584073.921970:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1784584073.922924:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784584073.922961:0:18687:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584073.922980:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584073.922993:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584073.923038:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584073.923040:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584073.923042:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584073.923043:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584073.923049:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584073.923050:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584073.923051:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584073.923053:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584073.923054:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584073.923057:0:18687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1784584073.923059:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584073.923061:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584073.923062:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584073.923063:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584073.923064:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584073.923064:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584073.923065:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584073.923066:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584073.923067:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584073.923093:0:18687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784584073.923114:0:18687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599192960:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584073.923181:0:18687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584073.923217:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599192960 00000100:00100000:1.0:1784584073.923224:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599192960 00000100:00100000:1.0:1784584073.923263:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784584073.923271:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599192960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784584073.923293:0:17180:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784584073.923304:0:17180:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784584073.924536:0:18687:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546f00 going to sleep for 11 seconds 20000000:01000000:1.0:1784584073.930650:0:17180:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784584073.930702:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784584073.930985:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:18687:x1871271599192960:12345-0@lo:253:mount.lustre.0 Request processed in 7710us (7799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584073.930997:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784584073.931094:0:18687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:18687:1871271599192960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584073.931109:0:18687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784584073.931112:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584073.931114:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784584073.931115:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584073.931116:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584073.931118:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584073.931119:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584073.931120:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584073.931122:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584073.931123:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584073.931137:0:18687:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1784584073.935656:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 20000000:01000000:3.0:1784584073.935838:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584073.935844:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584073.935866:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.935885:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 20 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.935893:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 20 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.935901:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.935940:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 20 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.935955:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 20 pid: 17179 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.935970:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599193088:0@lo:104: 00000100:00100000:3.0:1784584073.936035:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584073.936092:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 20 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936101:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 20 pid: 17180 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.936109:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599193216:0@lo:104: 00000100:00100000:3.0:1784584073.936133:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.936161:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584073.936186:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784584073.936204:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193088 00000100:00100000:3.0:1784584073.936209:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193088 00000100:00100000:3.0:1784584073.936239:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193216 00000100:00100000:3.0:1784584073.936242:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193216 00000100:00100000:3.0:1784584073.936255:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584073.936262:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599193088:12345-0@lo:104: 00010000:00010000:3.0:1784584073.936274:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936325:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584073.936330:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599193088:12345-0@lo:104: Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.936337:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584073.936354:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584073.936360:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b403464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599193216:12345-0@lo:104: 00010000:00010000:3.0:1784584073.936378:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936411:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584073.936415:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b403464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:17202:x1871271599193216:12345-0@lo:104: Request processed in 56us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.936420:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1784584073.936457:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584073.936462:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936490:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584073.936500:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936508:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584073.936514:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584073.936519:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584073.936547:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936553:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584073.936572:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936579:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9a00/0xdab2421a42e48c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c29 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936591:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584073.936594:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936599:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584073.936601:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936607:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584073.936623:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584073.936627:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584073.936640:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936645:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584073.936651:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936656:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c1b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.936667:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584073.936668:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584073.936669:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584073.936676:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584073.936693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599193344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584073.937141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.937171:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584073.937177:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599193472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584073.937202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584073.937244:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193344 00000100:00100000:3.0:1784584073.937249:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193344 00010000:00010000:3.0:1784584073.937268:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 21 pid: 17179 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.937288:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193472 00000100:00100000:3.0:1784584073.937298:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193472 00010000:00010000:3.0:1784584073.937314:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 22 pid: 17180 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.937328:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584073.937334:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3641:x1871271599193344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584073.937343:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584073.937348:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 22 pid: 17179 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937358:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 22 pid: 17179 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937382:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584073.937414:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3641:x1871271599193344:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.937421:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584073.937434:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584073.937440:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3641:x1871271599193472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584073.937447:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584073.937451:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 21 pid: 17180 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937459:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 21 pid: 17180 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937488:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937496:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584073.937516:0:17172:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006922807s 00010000:00010000:3.0:1784584073.937520:0:17172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937528:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937535:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937541:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937547:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584073.937551:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937558:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937567:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937576:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584073.937602:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3641:x1871271599193472:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584073.937608:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584073.937666:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599193472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584073.937674:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599193344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584073.937724:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cea00/0xdab2421a42e48c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48c22 expref: 20 pid: 17179 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.937735:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599193088:0@lo:104: 00010000:00010000:3.0:1784584073.937744:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48c14 expref: 19 pid: 17180 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584073.937751:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599193216:0@lo:104: 00010000:00010000:3.0:1784584073.937763:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937772:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937778:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584073.937784:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97600/0xdab2421a42e48cd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784584073.947179:0:18687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784584073.947187:0:18687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784584073.947221:0:18687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784584073.947267:0:18687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784584073.947288:0:18687:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784584073.947311:0:18687:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784584073.952211:0:18687:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584073.952493:0:18687:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1784584074.745713:0:18769:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584074.745998:0:18769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584074.866070:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584075.886076:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584075.886910:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584075.886917:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b437661000 from 9 10000000:01000000:1.0:1784584075.886922:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584075.886972:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.887002:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.887193:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584075.887221:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584075.887291:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584075.887384:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784584075.887637:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193600 00000100:00100000:0.0:1784584075.887646:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193600 00000100:00100000:0.0:1784584075.887758:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784584075.887768:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:17184:x1871271599193600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584075.887782:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584075.887796:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48cd8 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584075.887819:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584075.887830:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584075.887839:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9c00, rc 0) 00000100:00100000:0.0:1784584075.887896:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:17184:x1871271599193600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584075.887913:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784584075.887985:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584075.888001:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.888021:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584075.888074:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584075.888104:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584075.888339:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584075.888580:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193728 00000100:00100000:3.0:1784584075.888585:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193728 00000100:00100000:3.0:1784584075.888612:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784584075.888619:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:17184:x1871271599193728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584075.888635:0:17179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584075.888652:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584075.888660:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1784584075.888767:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:17184:x1871271599193728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584075.888775:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784584075.888881:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584075.888944:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584075.888951:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.888959:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584075.888979:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584075.888981:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b3041fd000 from 9 10000000:01000000:1.0:1784584075.888984:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584075.889004:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.889022:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.889030:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584075.889044:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584075.889070:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584075.889099:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584075.889201:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193856 00000100:00100000:3.0:1784584075.889206:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193856 00000100:00100000:3.0:1784584075.889225:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784584075.889230:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:17184:x1871271599193856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584075.889237:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584075.889247:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48ce6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584075.889263:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584075.889270:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584075.889277:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96800, rc 0) 00000100:00100000:3.0:1784584075.889318:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599193856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584075.889323:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784584075.889555:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584075.889566:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.889574:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584075.889615:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584075.889645:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584075.889670:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584075.889718:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599193984 00000100:00100000:3.0:1784584075.889723:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599193984 00000100:00100000:3.0:1784584075.889741:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784584075.889747:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599193984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584075.889757:0:17179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584075.889767:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584075.889770:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1784584075.889869:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599193984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584075.889876:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784584075.889987:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599193984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584075.890038:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584075.890049:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584075.890057:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584075.950079:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584075.950105:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599194112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584075.950661:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584075.951209:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599194240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584075.951241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584075.958104:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194112 00000100:00100000:1.0:1784584075.958118:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194112 00000100:00100000:1.0:1784584075.958294:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194240 00000100:00100000:1.0:1784584075.958298:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194240 00000100:00100000:1.0:1784584075.958318:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784584075.958327:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599194112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784584075.958373:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584075.958440:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599194112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (7779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584075.958448:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784584075.958463:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784584075.958488:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599194240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784584075.958505:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784584075.958536:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599194240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584075.958542:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584075.959010:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599194240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584075.959028:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599194112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784584076.917064:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584077.935374:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584078.957768:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584079.021735:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584079.021742:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584079.021744:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584079.021748:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584079.021773:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584079.021776:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584079.021779:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584079.021782:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584079.021816:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599194496:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.021888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.021941:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599195008:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.021968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.021986:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784584079.021992:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599194368:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022021:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.022043:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599194880:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.022088:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599194624:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.022145:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599195136:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.022217:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584079.022224:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599194752:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584079.022277:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194496 00000100:00100000:2.0:1784584079.022284:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194496 00000100:00100000:2.0:1784584079.022325:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194752 00000100:00100000:2.0:1784584079.022339:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194752 00000100:00100000:2.0:1784584079.022357:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584079.022366:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599194496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022421:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599194496:12345-0@lo:400:kworker.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022428:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584079.022445:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584079.022451:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599194752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022504:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599194752:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022510:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584079.022528:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194368 00000100:00100000:2.0:1784584079.022531:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194368 00000100:00100000:2.0:1784584079.022554:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784584079.022561:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3642:x1871271599194368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022588:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3642:x1871271599194368:12345-0@lo:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022594:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784584079.022620:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195008 00000100:00100000:2.0:1784584079.022623:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195008 00000100:00100000:2.0:1784584079.022659:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194880 00000100:00100000:2.0:1784584079.022662:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194880 00000100:00100000:2.0:1784584079.022672:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599194624 00000100:00100000:2.0:1784584079.022674:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599194624 00000100:00100000:2.0:1784584079.022683:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195136 00000100:00100000:2.0:1784584079.022686:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195136 00000100:00100000:2.0:1784584079.022700:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584079.022705:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599195008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022735:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599195008:12345-0@lo:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022740:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584079.022752:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584079.022757:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599194880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022780:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599194880:12345-0@lo:400:kworker.0 Request processed in 23us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022786:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584079.022796:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584079.022801:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599194624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022825:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599194624:12345-0@lo:400:kworker.0 Request processed in 23us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022831:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584079.022841:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584079.022846:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599195136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.022871:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599195136:12345-0@lo:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584079.022877:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584079.022925:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599194752:0@lo:400:kworker.0 00010000:00080000:2.0:1784584079.022947:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b409218380 x1871271599194624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584079.022956:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599194624:0@lo:400:kworker.0 00010000:00080000:2.0:1784584079.022966:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40921b800 x1871271599195136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584079.022974:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599195136:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.023006:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599194368:0@lo:400:kworker.0 00010000:00080000:2.0:1784584079.023015:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b409218e00 x1871271599194880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584079.023024:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599194880:0@lo:400:kworker.0 00000100:00100000:2.0:1784584079.023033:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599194496:0@lo:400:kworker.0 00010000:00080000:2.0:1784584079.023041:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b409219500 x1871271599195008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584079.023049:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599195008:0@lo:400:kworker.0 00000100:00080000:0.0:1784584079.023369:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784584079.023375:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784584079.411189:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1784584079.752264:0:19059:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784584079.998082:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584080.688199:0:19111:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584080.688457:0:19111:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584081.005649:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584081.070186:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584081.070210:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599195264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584081.070276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584081.070346:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195264 00000100:00100000:0.0:1784584081.070354:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195264 00000100:00100000:0.0:1784584081.070401:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784584081.070409:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599195264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784584081.070444:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584081.070509:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599195264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584081.070517:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784584081.070581:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599195264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584081.070646:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599195392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584081.070673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584081.071452:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195392 00000100:00100000:3.0:1784584081.071731:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195392 00000100:00100000:3.0:1784584081.071869:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584081.071879:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599195392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584081.071906:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584081.071986:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599195392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584081.071992:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784584081.072072:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599195392:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1784584081.464636:0:19161:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584081.464842:0:19161:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584082.029820:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584082.990137:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784584083.053836:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584084.077726:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584084.143995:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599195520:0@lo:400:kworker.0 00000100:00100000:3.0:1784584084.144077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784584084.144185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584084.144190:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584084.144192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584084.144195:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584084.144247:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195520 00000100:00100000:1.0:1784584084.144254:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195520 00000100:00100000:1.0:1784584084.144321:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784584084.144329:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3642:x1871271599195520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784584084.145958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584084.145965:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584084.145968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584084.145978:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584084.146602:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599195776:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.146663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584084.146692:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599196288:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.146713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584084.146748:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784584084.146754:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599195648:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.146780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584084.146800:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599196160:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.146819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584084.146850:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195776 00000100:00100000:2.0:1784584084.146856:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195776 00000100:00100000:2.0:1784584084.146895:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196288 00000100:00100000:2.0:1784584084.146898:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196288 00000100:00100000:2.0:1784584084.146921:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196160 00000100:00100000:2.0:1784584084.146924:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196160 00000100:00100000:2.0:1784584084.146938:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584084.146945:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599195776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584084.147012:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599195904:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.147538:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599195776:12345-0@lo:400:kworker.0 Request processed in 591us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.147545:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584084.147565:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584084.147572:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599196288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.147603:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599196288:12345-0@lo:400:kworker.0 Request processed in 32us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.147609:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584084.147618:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584084.147624:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599196160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.147648:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599196160:12345-0@lo:400:kworker.0 Request processed in 24us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.147653:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584084.147676:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195648 00000100:00100000:2.0:1784584084.147686:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195648 00000100:00100000:2.0:1784584084.147711:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584084.147716:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599195648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.147745:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599195648:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.147751:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784584084.147771:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584084.147775:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584084.147805:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599195648:0@lo:400:kworker.0 00010000:00080000:2.0:1784584084.147817:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef19880 x1871271599196160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584084.147827:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599196160:0@lo:400:kworker.0 00010000:00080000:2.0:1784584084.147836:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b800 x1871271599195776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584084.147843:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599195776:0@lo:400:kworker.0 00010000:00080000:2.0:1784584084.147852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1a680 x1871271599196288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584084.147859:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599196288:0@lo:400:kworker.0 00000100:00100000:0.0:1784584084.148384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584084.148420:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584084.148428:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599196032:0@lo:400:kworker.0 00000100:00100000:0.0:1784584084.148460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584084.149672:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599195904 00000100:00100000:2.0:1784584084.149682:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599195904 00000100:00100000:2.0:1784584084.149723:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584084.149731:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599195904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.149803:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599195904:12345-0@lo:400:kworker.0 Request processed in 72us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.149809:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584084.149841:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196032 00000100:00100000:2.0:1784584084.149845:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196032 00000100:00100000:2.0:1784584084.149866:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784584084.149872:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599196032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.149902:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599196032:12345-0@lo:400:kworker.0 Request processed in 31us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584084.149909:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784584084.149940:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1a300 x1871271599196032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584084.149951:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599196032:0@lo:400:kworker.0 00000100:00100000:2.0:1784584084.149960:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599195904:0@lo:400:kworker.0 00000100:00100000:1.0:1784584084.152117:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3642:x1871271599195520:12345-0@lo:400:kworker.0 Request processed in 7778us (8029us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584084.152130:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784584084.154853:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599195520:0@lo:400:kworker.0 00010000:00010000:3.0:1784584085.101582:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584085.166527:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584070/real 1784584070] req@ffff98b42f7cc380 x1871271599188608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584085.166558:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b42f7cc380 x1871271599188608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584085.166568:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584070/real 1784584070] req@ffff98b42f7ced80 x1871271599188736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584085.166578:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b42f7ced80 x1871271599188736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584085.166597:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584085.166606:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584085.166609:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599188608:0@lo:8:kworker.0 00000100:00080000:3.0:1784584085.166615:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584085.166619:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584085.166621:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599188736:0@lo:8:kworker.0 00000100:00080000:2.0:1784584085.167935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584085.167940:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584085.167943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584085.167946:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584085.167963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584085.167966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584085.167968:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584085.167974:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1784584085.167980:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584085.167986:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43ed10000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584085.168004:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302426680 x1871271599196928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584085.168018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584085.168032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584085.168034:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584085.168037:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1784584085.168039:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584085.168043:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584085.168058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302427480 x1871271599197056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584085.168096:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599196416:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168187:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599197184:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168229:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784584085.168234:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599196544:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168264:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599197312:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168313:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599196672:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168345:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599197440:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168377:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584085.168381:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599196800:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.168401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.168428:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196416 00000100:00100000:2.0:1784584085.168433:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196416 00000100:00100000:2.0:1784584085.168497:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784584085.168504:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3641:x1871271599196416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170306:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3641:x1871271599196416:12345-0@lo:400:kworker.0 Request processed in 1785us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170320:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784584085.170368:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197184 00000100:00100000:2.0:1784584085.170375:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197184 00000100:00100000:2.0:1784584085.170399:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197312 00000100:00100000:2.0:1784584085.170401:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197312 00000100:00100000:2.0:1784584085.170411:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196672 00000100:00100000:2.0:1784584085.170413:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196672 00000100:00100000:2.0:1784584085.170421:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197440 00000100:00100000:2.0:1784584085.170423:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197440 00000100:00100000:2.0:1784584085.170434:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584085.170440:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599197184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170485:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599197184:12345-0@lo:400:kworker.0 Request processed in 45us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170491:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584085.170502:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584085.170507:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170539:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599197312:12345-0@lo:400:kworker.0 Request processed in 32us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170545:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584085.170553:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584085.170558:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599196672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170582:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599196672:12345-0@lo:400:kworker.0 Request processed in 24us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170602:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584085.170612:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584085.170617:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599197440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170639:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599197440:12345-0@lo:400:kworker.0 Request processed in 22us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170644:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584085.170658:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196544 00000100:00100000:2.0:1784584085.170661:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196544 00000100:00100000:2.0:1784584085.170680:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196800 00000100:00100000:2.0:1784584085.170683:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196800 00000100:00100000:2.0:1784584085.170693:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584085.170697:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599196544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170723:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599196544:12345-0@lo:400:kworker.0 Request processed in 26us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170729:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584085.170737:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584085.170742:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599196800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170761:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599196800:12345-0@lo:400:kworker.0 Request processed in 19us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.170766:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584085.170816:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599196800:0@lo:400:kworker.0 00010000:00080000:2.0:1784584085.170829:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424700 x1871271599196672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.170840:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599196672:0@lo:400:kworker.0 00010000:00080000:2.0:1784584085.170848:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424000 x1871271599197440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.170862:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599197440:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170892:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599196544:0@lo:400:kworker.0 00010000:00080000:2.0:1784584085.170901:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302427800 x1871271599197312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.170909:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599197312:0@lo:400:kworker.0 00000100:00100000:2.0:1784584085.170917:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599196416:0@lo:400:kworker.0 00010000:00080000:2.0:1784584085.170925:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424a80 x1871271599197184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.170933:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599197184:0@lo:400:kworker.0 00000100:00100000:3.0:1784584085.171033:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599196928:0@lo:8:kworker.0 00000100:00100000:3.0:1784584085.171064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584085.171105:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599197056:0@lo:8:kworker.0 00000100:00100000:3.0:1784584085.171121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.171423:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599196928 00000100:00100000:2.0:1784584085.171429:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599196928 00000100:00100000:2.0:1784584085.171849:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197056 00000100:00100000:2.0:1784584085.171854:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197056 00000100:00100000:3.0:1784584085.172088:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584085.172095:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599196928:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784584085.172122:0:18694:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1784584085.172157:0:18694:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48cf4 00002000:00100000:3.0:1784584085.172170:0:18694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98b430f6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784584085.172175:0:18694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784584085.172177:0:18694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784584085.172331:0:18694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1784584085.172353:0:18694:0:(import.c:65:import_set_state_nolock()) ffff98b430f69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584085.172411:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599196928:12345-0@lo:8:kworker.0 Request processed in 315us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584085.172418:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584085.172431:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584085.172435:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599197056:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784584085.172446:0:18694:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1784584085.172713:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426680 x1871271599196928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.172723:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584085.172730:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784584085.172736:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784584085.172741:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784584085.172743:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784584085.172759:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784584085.172764:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599196928:0@lo:8:kworker.0 00000004:00080000:1.0:1784584085.172771:0:17928:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784584085.172815:0:17929:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784584085.172842:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197696:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1784584085.172871:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.172888:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584085.172900:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599197568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784584085.172923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.172950:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784584085.172957:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784584085.173030:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197696 00000100:00100000:2.0:1784584085.173034:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197696 00000100:00080000:2.0:1784584085.173063:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584085.173121:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584085.173128:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1871271599197696:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1784584085.173235:0:17928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 528358766574ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784584085.173241:0:17928:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784584085.173268:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197568 00000100:00100000:1.0:1784584085.173272:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197568 00000100:00100000:1.0:1784584085.173305:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584085.173313:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1871271599197568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784584085.173329:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584085.173917:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1871271599197568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 603us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584085.173925:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784584085.174693:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b409218e00 x1871271599197568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.174715:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b409218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599197568:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1784584085.182160:0:17919:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1784584085.182613:0:19378:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784584085.182619:0:19378:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1784584085.182716:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1871271599197696:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9584us (9840us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.182728:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784584085.182778:0:17929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40921bb80 x1871271599197696/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784584101 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584085.182804:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197696:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1784584085.182819:0:17929:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1784584085.182854:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197824:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1784584085.182887:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584085.182916:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584085.182934:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197824 00000100:00100000:2.0:1784584085.182939:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197824 00000100:00100000:2.0:1784584085.183172:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584085.183183:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17929:x1871271599197824:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784584085.183209:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1784584085.183250:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17929:x1871271599197824:12345-0@lo:5:osp-pre-0-1.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584085.183257:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784584085.183319:0:17929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40921bb80 x1871271599197824/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584101 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584085.183330:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197824:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784584085.183339:0:17929:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1784584085.183364:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197952:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784584085.183391:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584085.186635:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe9180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584085.187422:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599197056:12345-0@lo:8:kworker.0 Request processed in 14977us (16291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584085.187434:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784584085.187525:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584085.187530:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784584085.187534:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599197056:0@lo:8:kworker.0 00000100:00100000:1.0:1784584085.188073:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599197952 00000100:00100000:1.0:1784584085.188080:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599197952 00000100:00100000:1.0:1784584085.188121:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584085.188128:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17929:x1871271599197952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1784584085.188164:0:18693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1784584085.204896:0:18688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1784584085.204909:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784584085.205359:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17929:x1871271599197952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 17226us (21962us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784584085.205371:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784584085.205445:0:17929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1b800 x1871271599197952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584085.205457:0:17929:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784584085.205463:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17929:1871271599197952:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784584085.205596:0:17929:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1784584085.205778:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17929:1871271599198080:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784584085.205890:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584085.205946:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b403b9f480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584085.205992:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198080 00000100:00100000:0.0:1784584085.206000:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198080 00000100:00100000:0.0:1784584085.206076:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584085.206085:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1871271599198080:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1784584085.206141:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1871271599198080:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584085.206148:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784584085.206203:0:17929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b303962d80 x1871271599198080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584085.206226:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17929:1871271599198080:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1784584086.129206:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584086.189668:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584086.194429:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599198208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584086.194524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584086.194633:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198208 00000100:00100000:2.0:1784584086.194640:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198208 00000100:00100000:2.0:1784584086.194694:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584086.194702:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599198208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784584086.194738:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784584086.194791:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599198208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584086.194797:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584086.194839:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599198208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584086.195012:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599198336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584086.195039:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584086.195128:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198336 00000100:00100000:1.0:1784584086.195132:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198336 00000100:00100000:1.0:1784584086.195164:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584086.195172:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b409219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599198336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784584086.195191:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584086.195268:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b409219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599198336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584086.195274:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784584086.195354:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599198336:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784584087.149713:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784584087.325196:0:19507:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784584087.325200:0:19507:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784584087.325202:0:19507:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784584087.325353:0:19507:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b303408000 00000020:01000004:0.0:1784584087.325368:0:19507:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784584087.325383:0:19507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784584087.325396:0:19507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98b302443380) 00000020:00000080:0.0:1784584087.325412:0:19507:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784584087.408149:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784584087.412418:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784584087.414624:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1784584087.414971:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784584087.415205:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784584087.415619:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784584087.415903:0:19507:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1784584087.419115:0:19507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784584087.419419:0:19507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1784584087.419433:0:19507:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784584087.419444:0:19507:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e48d02 00000020:01000004:1.0:1784584087.419450:0:19507:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784584087.419636:0:19507:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784584087.419642:0:19507:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784584087.419648:0:19507:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784584087.419791:0:19507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784584087.419796:0:19507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784584087.432617:0:19507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784584087.432717:0:19507:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784584087.432721:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784584087.432727:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584087.432728:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584087.432730:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584087.432731:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584087.432732:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584087.432733:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584087.432735:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584087.432736:0:19507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584087.432740:0:19507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784584087.432742:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784584087.432743:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584087.432744:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584087.432745:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584087.432746:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584087.432747:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584087.432748:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584087.432749:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584087.432750:0:19507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584087.432776:0:19507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784584087.432796:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784584087.432864:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.433050:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584087.433144:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198464 00000100:00100000:1.0:1784584087.433152:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198464 00000100:00100000:1.0:1784584087.433233:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784584087.433337:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:19507:x1871271599198464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784584087.433365:0:17180:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784584087.433368:0:17180:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1784584087.433372:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784584087.434206:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:19507:x1871271599198464:12345-0@lo:253:mount.lustre.0 Request processed in 869us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.434215:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784584087.434455:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584087.434488:0:19507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784584087.434491:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584087.434493:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584087.434494:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584087.434495:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584087.434496:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584087.434497:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584087.434499:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584087.434595:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584087.434596:0:19507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784584087.434616:0:19507:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b303408000 from lustre-OST0001 10000000:01000000:3.0:1784584087.434698:0:19507:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784584087.434702:0:19507:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784584087.434710:0:19507:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302a499c0 local copy 00010000:00010000:3.0:1784584087.434728:0:19507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584087.434810:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.434842:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.434880:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.434919:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198592 00000100:00100000:2.0:1784584087.434925:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198592 00000100:00100000:2.0:1784584087.434998:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784584087.435006:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:19507:x1871271599198592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584087.435091:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:19507:x1871271599198592:12345-0@lo:501:mount.lustre.0 Request processed in 86us (248us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584087.435098:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784584087.435145:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198592:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784584087.435156:0:19507:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784584087.435169:0:19507:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784584087.435175:0:19507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.435184:0:19507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584087.435206:0:19507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b303408000 10000000:01000000:3.0:1784584087.435209:0:19507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784584087.435214:0:19507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784584087.435216:0:19507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584087.435219:0:19507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784584087.435222:0:19507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784584087.435253:0:19507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.435261:0:19507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.435269:0:19507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584087.435299:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584087.435321:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.435824:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259840 going to sleep for 11 seconds 00000100:00100000:0.0:1784584087.435911:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198720 00000100:00100000:0.0:1784584087.435917:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198720 00000100:00100000:0.0:1784584087.435943:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784584087.435951:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:19507:x1871271599198720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584087.435961:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584087.435975:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd8600/0xdab2421a42e48d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48d09 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.436011:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd8600/0xdab2421a42e48d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48d09 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.436022:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd8600/0xdab2421a42e48d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d09 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.436031:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8600, rc 0) 00000100:00100000:0.0:1784584087.436087:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599198720:12345-0@lo:101:mount.lustre.0 Request processed in 135us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.436093:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784584087.436218:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584087.436232:0:19507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.436255:0:19507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584087.437874:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784584087.438753:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584087.448414:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784584087.448609:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784584087.448695:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784584087.448713:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784584087.448726:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784584087.448740:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784584087.448766:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784584087.448771:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784584087.448872:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.448936:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.448991:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584087.449123:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198848 00000100:00100000:0.0:1784584087.449130:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198848 00000100:00100000:0.0:1784584087.449180:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784584087.449189:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599198848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584087.449404:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599198848:12345-0@lo:501:mount.lustre.0 Request processed in 216us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.449412:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784584087.449718:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.449751:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584087.449796:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.449831:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.449916:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599198976 00000100:00100000:2.0:1784584087.449921:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599198976 00000100:00100000:2.0:1784584087.449952:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784584087.449959:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599198976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584087.452353:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599198976:12345-0@lo:503:mount.lustre.0 Request processed in 2386us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.452366:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784584087.452692:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599198976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584087.453784:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584087.453870:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584087.453942:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584087.453989:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.454210:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199104 00000100:00100000:2.0:1784584087.454217:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199104 00000100:00100000:2.0:1784584087.454264:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784584087.454273:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599199104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584087.455088:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599199104:12345-0@lo:502:mount.lustre.0 Request processed in 814us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.455099:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784584087.455259:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584087.455606:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784584087.455646:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784584087.455662:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784584087.455674:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784584087.455686:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784584087.455701:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784584087.455715:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784584087.455729:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784584087.455742:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784584087.455770:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584087.455816:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584087.455950:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af300 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.456418:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199232 00000100:00100000:3.0:1784584087.456425:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199232 00000100:00100000:3.0:1784584087.456658:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784584087.456668:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599199232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.456795:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599199232:12345-0@lo:502:mount.lustre.0 Request processed in 128us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.456803:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784584087.456908:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584087.456976:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1784584087.456986:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1784584087.458765:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584087.458776:0:19511:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1784584087.458783:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584087.458786:0:19511:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1784584087.458791:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584087.458807:0:19511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98b4331e0000) 00000020:00000080:1.0:1784584087.458830:0:19511:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784584087.458836:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784584087.458916:0:19511:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b303408000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1784584087.458925:0:19511:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784584087.458931:0:19511:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e48d1e 00010000:00010000:1.0:1784584087.469928:0:19511:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1784584087.470513:0:19511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1784584087.472407:0:19511:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1784584087.474121:0:19511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784584087.474134:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584087.474141:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584087.474142:0:19511:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784584087.474146:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584087.474150:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584087.474151:0:19511:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784584087.474154:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784584087.474156:0:19511:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784584087.474158:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584087.474160:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584087.474161:0:19511:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784584087.474163:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584087.474165:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584087.474166:0:19511:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784584087.474169:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784584087.474195:0:19511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584087.474198:0:19511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584087.474199:0:19511:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784584087.474203:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1784584087.474433:0:19507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1784584087.474463:0:19507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784584087.474913:0:19507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.474927:0:19507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584087.474935:0:19507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b303408000 from 1 10000000:01000000:0.0:1784584087.474938:0:19507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584087.474977:0:19507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.474985:0:19507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.474995:0:19507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584087.475022:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584087.475206:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.475286:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b402aac540 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.481399:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199360 00000100:00100000:3.0:1784584087.481422:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199360 00000100:00100000:1.0:1784584087.481763:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784584087.481774:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:19507:x1871271599199360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584087.481790:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584087.481808:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48d25 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584087.481836:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584087.481848:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584087.481856:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4172cf800, rc 0) 00000100:00100000:1.0:1784584087.481934:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199360:12345-0@lo:101:mount.lustre.0 Request processed in 163us (6726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.481946:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784584087.482025:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584087.482053:0:19507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.482063:0:19507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584087.483298:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784584087.483742:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584087.483919:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784584087.483946:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784584087.483963:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784584087.483968:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784584087.484169:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.484231:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.484342:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584087.484819:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199488 00000100:00100000:1.0:1784584087.484826:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199488 00000100:00100000:1.0:1784584087.484867:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784584087.484875:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584087.484972:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199488:12345-0@lo:501:mount.lustre.0 Request processed in 98us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.484979:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784584087.485083:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.485114:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584087.485147:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.485176:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584087.485263:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199616 00000100:00100000:1.0:1784584087.485267:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199616 00000100:00100000:1.0:1784584087.485294:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784584087.485299:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584087.485383:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199616:12345-0@lo:503:mount.lustre.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.485390:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784584087.485611:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584087.485975:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584087.487967:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.488126:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.488178:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.489352:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199744 00000100:00100000:3.0:1784584087.489374:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199744 00000100:00100000:3.0:1784584087.489417:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784584087.489425:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.489616:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199744:12345-0@lo:502:mount.lustre.0 Request processed in 191us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.489728:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.489736:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000040:00080000:0.0:1784584087.489990:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784584087.490021:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784584087.490034:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784584087.490046:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784584087.490058:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784584087.490070:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784584087.490083:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784584087.490096:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1784584087.490110:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784584087.490123:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1784584087.490136:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1784584087.490167:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584087.490211:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.490247:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b420c0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.490305:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599199872 00000100:00100000:3.0:1784584087.490315:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599199872 00000100:00100000:3.0:1784584087.490387:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784584087.490395:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.490661:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599199872:12345-0@lo:502:mount.lustre.0 Request processed in 266us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.490669:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784584087.491926:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599199872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584087.492006:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1784584087.492026:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784584087.492944:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584087.492956:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.492959:0:19515:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584087.492966:0:19515:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b303408000 00000020:00000080:0.0:1784584087.492969:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584087.492977:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584087.492979:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.492981:0:19515:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784584087.492983:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584087.492991:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.492993:0:19515:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784584087.492996:0:19515:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b303408000 00000020:00000080:0.0:1784584087.492998:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584087.493062:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584087.493066:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.493067:0:19515:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784584087.493069:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584087.493072:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.493073:0:19515:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584087.493076:0:19515:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b303408000 00000020:00000080:0.0:1784584087.493078:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584087.493094:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584087.493097:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.493098:0:19515:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584087.493100:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584087.493102:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.493103:0:19515:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784584087.493107:0:19515:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b303408000 00000020:00000080:0.0:1784584087.493108:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584087.493141:0:19515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584087.493145:0:19515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584087.493146:0:19515:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784584087.493149:0:19515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1784584087.493345:0:19507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784584087.493370:0:19507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584087.493389:0:19507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.493400:0:19507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584087.493448:0:19507:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784584087.493451:0:19507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b303408000 10000000:01000000:3.0:1784584087.493453:0:19507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b303408000 10000000:01000000:3.0:1784584087.493457:0:19507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584087.493463:0:19507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b303408000 from 1 10000000:01000000:3.0:1784584087.493495:0:19507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784584087.493539:0:19507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.493554:0:19507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.493565:0:19507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584087.493588:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584087.493878:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.493931:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.493990:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200000 00000100:00100000:2.0:1784584087.493997:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200000 00000100:00100000:2.0:1784584087.494048:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784584087.494058:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:19507:x1871271599200000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584087.494070:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584087.494082:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0a00/0xdab2421a42e48d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48d33 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.494103:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0a00/0xdab2421a42e48d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48d33 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.494113:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0a00/0xdab2421a42e48d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d33 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.494132:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0a00, rc 0) 00000100:00100000:2.0:1784584087.494168:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200000:12345-0@lo:101:mount.lustre.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.494174:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584087.495543:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584087.495565:0:19507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.495576:0:19507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584087.497736:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1784584087.498003:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584087.498897:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784584087.498924:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784584087.498938:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784584087.498951:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784584087.498979:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784584087.498995:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784584087.499008:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784584087.499020:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784584087.499032:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784584087.499058:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784584087.499081:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784584087.499095:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784584087.499108:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784584087.499121:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784584087.499133:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784584087.499144:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784584087.499155:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784584087.499166:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784584087.499179:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784584087.499191:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784584087.499214:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784584087.499229:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784584087.499243:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784584087.499258:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784584087.499272:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1784584087.499300:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1784584087.499315:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1784584087.499330:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1784584087.499451:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1784584087.499724:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1784584087.499746:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1784584087.499761:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1784584087.499776:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1784584087.499789:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1784584087.499802:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1784584087.499814:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1784584087.499842:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1784584087.499858:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1784584087.499872:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1784584087.499884:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1784584087.499895:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1784584087.499909:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1784584087.499922:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1784584087.499946:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1784584087.499960:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1784584087.499973:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1784584087.499995:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1784584087.500000:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1784584087.500109:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.500173:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.500227:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.500354:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200128 00000100:00100000:2.0:1784584087.500362:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200128 00000100:00100000:2.0:1784584087.500409:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784584087.500420:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584087.500572:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200128:12345-0@lo:501:mount.lustre.0 Request processed in 153us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.500581:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784584087.501741:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584087.501798:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584087.501859:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.501932:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259780 going to sleep for 11 seconds 00000100:00100000:1.0:1784584087.504735:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200256 00000100:00100000:1.0:1784584087.504748:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200256 00000100:00100000:1.0:1784584087.504808:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784584087.504819:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584087.504967:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200256:12345-0@lo:503:mount.lustre.0 Request processed in 149us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.504975:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784584087.505091:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584087.505736:0:19507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584087.505811:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.505863:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.505904:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259000 going to sleep for 11 seconds 00000100:00100000:1.0:1784584087.506133:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200384 00000100:00100000:1.0:1784584087.506139:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200384 00000100:00100000:1.0:1784584087.506179:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784584087.506187:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584087.506297:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200384:12345-0@lo:502:mount.lustre.0 Request processed in 110us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.506304:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784584087.507227:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584087.507535:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784584087.507565:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784584087.507583:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784584087.507608:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784584087.508714:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784584087.508756:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784584087.508773:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784584087.508787:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784584087.508803:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784584087.508829:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784584087.508843:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784584087.508857:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784584087.508872:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784584087.508884:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784584087.508897:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784584087.508911:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784584087.508926:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784584087.508941:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784584087.508955:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784584087.508981:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784584087.508998:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784584087.509010:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784584087.509021:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784584087.510586:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784584087.511153:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1784584087.511173:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1784584087.511187:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1784584087.511200:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1784584087.511212:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1784584087.511225:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1784584087.511238:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1784584087.511251:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1784584087.511263:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1784584087.511287:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1784584087.511303:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1784584087.511330:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1784584087.512970:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1784584087.512994:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1784584087.513007:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1784584087.513018:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1784584087.513030:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1784584087.513483:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1784584087.513512:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1784584087.513526:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1784584087.513537:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1784584087.513549:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1784584087.513562:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1784584087.513576:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1784584087.513714:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.513788:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.513843:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200512 00000100:00100000:3.0:1784584087.513849:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200512 00000100:00100000:3.0:1784584087.513897:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784584087.513906:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.514023:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200512:12345-0@lo:502:mount.lustre.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.514030:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784584087.514093:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.514115:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584087.514286:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1784584087.514309:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1784584087.514329:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.514378:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.514403:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200640 00000100:00100000:3.0:1784584087.514406:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200640 00000100:00100000:3.0:1784584087.514430:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784584087.514436:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584087.514511:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599200640:12345-0@lo:502:mount.lustre.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.514526:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784584087.514554:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.514566:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599200640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584087.514599:0:19507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1784584087.514606:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784584087.519968:0:19519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784584087.519984:0:19519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98b302444d40) 00000020:00000080:0.0:1784584087.520008:0:19519:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1784584087.523645:0:19519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b303408000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584087.523655:0:19519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b303408000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584087.523658:0:19519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b303408000 3 00010000:00080000:2.0:1784584087.523708:0:19519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3048f4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584087.525324:0:19519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1784584087.525427:0:19519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784584087.525494:0:19519:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584087.525507:0:19519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdab2421a42e48d48 00000100:00080000:2.0:1784584087.525517:0:19519:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584087.525522:0:19519:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b3048f4000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584087.525556:0:19519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b40921bb80 x1871271599200768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584087.525597:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599200768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584087.525663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584087.525729:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200768 00000100:00100000:2.0:1784584087.525736:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200768 00000100:00100000:2.0:1784584087.525765:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584087.525772:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599200768:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784584087.525793:0:18716:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1784584087.525829:0:18716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdab2421a42e48d4f 00000004:00100000:2.0:1784584087.525843:0:18716:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784584087.525871:0:18716:0:(import.c:65:import_set_state_nolock()) ffff98b3048f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584087.525918:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1871271599200768:12345-0@lo:38:llog_process_th.0 Request processed in 145us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.525925:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784584087.525960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b40921bb80 x1871271599200768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584087.525969:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584087.525976:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784584087.525983:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784584087.525987:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784584087.525989:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584087.525994:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599200768:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784584087.526015:0:19519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584087.526908:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584087.526913:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584087.526916:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584087.526919:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584087.526962:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584087.526965:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784584087.526968:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584087.526973:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1784584087.526977:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784584087.526981:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584087.526995:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef1b480 x1871271599201408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584087.527138:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599201152:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.527187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.527214:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599201792:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.527238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.527260:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584087.527265:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599201280:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.527301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.527345:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201152 00000100:00100000:0.0:1784584087.527351:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201152 00000100:00100000:0.0:1784584087.527390:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584087.527399:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599201152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.527444:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599201152:12345-0@lo:400:kworker.0 Request processed in 46us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.527451:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584087.527494:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201792 00000100:00100000:0.0:1784584087.527497:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201792 00000100:00100000:0.0:1784584087.527530:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784584087.527537:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599201792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.527575:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599201792:12345-0@lo:400:kworker.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.527582:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784584087.527606:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599201408:0@lo:8:kworker.0 00000100:00100000:2.0:1784584087.528256:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599201024:0@lo:400:kworker.0 00000100:00100000:3.0:1784584087.528444:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599200896:0@lo:400:kworker.0 00000100:00100000:2.0:1784584087.528508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584087.528534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599201664:0@lo:400:kworker.0 00000100:00100000:2.0:1784584087.528554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584087.528587:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201280 00000100:00100000:2.0:1784584087.528596:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201280 00000100:00100000:2.0:1784584087.528630:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584087.528639:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599201280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584087.528676:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599201280:12345-0@lo:400:kworker.0 Request processed in 39us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.528682:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784584087.528701:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584087.528705:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584087.528725:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201024 00000100:00100000:2.0:1784584087.528728:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201024 00000100:00100000:2.0:1784584087.528750:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201664 00000100:00100000:2.0:1784584087.528753:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201664 00000100:00100000:2.0:1784584087.529961:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584087.529972:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599201024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584087.530031:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599201024:12345-0@lo:400:kworker.0 Request processed in 61us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.530038:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584087.530052:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584087.530058:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599201664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584087.530083:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599201664:12345-0@lo:400:kworker.0 Request processed in 26us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.530088:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784584087.530113:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784584087.530142:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1bb80 x1871271599201024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584087.530156:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599201024:0@lo:400:kworker.0 00010000:00080000:2.0:1784584087.530168:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b437698380 x1871271599201664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584087.530183:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599201664:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.531488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784584087.531558:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef18e00 x1871271599201280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584087.531571:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599201280:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.531584:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599201152:0@lo:400:kworker.0 00010000:00080000:0.0:1784584087.531595:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43769b480 x1871271599201792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584087.531603:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599201792:0@lo:400:kworker.0 00000100:00100000:1.0:1784584087.532311:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201408 00000100:00100000:1.0:1784584087.532320:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201408 00000100:00100000:1.0:1784584087.532368:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584087.532375:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599201408:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1784584087.532448:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599201408:12345-0@lo:8:kworker.0 Request processed in 72us (980us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784584087.532455:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584087.532596:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784584087.532603:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584087.532607:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784584087.532610:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599201408:0@lo:8:kworker.0 00000100:00100000:3.0:1784584087.532731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584087.532805:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599201536:0@lo:400:kworker.0 00000100:00100000:3.0:1784584087.532836:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584087.532919:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201536 00000100:00100000:1.0:1784584087.532923:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201536 00000100:00100000:1.0:1784584087.532961:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584087.532968:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599201536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584087.533007:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599201536:12345-0@lo:400:kworker.0 Request processed in 40us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.533014:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1784584087.533076:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43ef1a300 x1871271599201536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584087.533086:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599201536:0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.533170:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599200896 00000100:00100000:0.0:1784584087.533174:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599200896 00000100:00100000:0.0:1784584087.533235:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584087.533242:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584087.533294:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599200896:12345-0@lo:400:kworker.0 Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.533300:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784584087.533360:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599200896:0@lo:400:kworker.0 00000020:01000004:2.0:1784584087.533681:0:19519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784584087.533706:0:19519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98b302bf19c0) 00000020:00000080:2.0:1784584087.534315:0:19519:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784584087.534464:0:19519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b303408000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584087.534503:0:19519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b303408000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584087.534506:0:19519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b303408000 3 00010000:00080000:2.0:1784584087.534532:0:19519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3048f1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584087.536238:0:19519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1784584087.536375:0:19519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784584087.536416:0:19519:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584087.536429:0:19519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdab2421a42e48d5d 00000100:00080000:2.0:1784584087.536439:0:19519:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584087.536444:0:19519:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98b3048f1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584087.536493:0:19519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302424e00 x1871271599201920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584087.536514:0:19519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784584087.537146:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584087.537151:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584087.537154:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584087.537156:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584087.537263:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599201920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784584087.537641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584087.537739:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599201920 00000100:00100000:1.0:1784584087.537746:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599201920 00000100:00100000:1.0:1784584087.537789:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584087.537797:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599201920:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784584087.537822:0:17187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1784584087.537867:0:17187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdab2421a42e48d64 00000004:00100000:1.0:1784584087.537882:0:17187:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784584087.537911:0:17187:0:(import.c:65:import_set_state_nolock()) ffff98b302466800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584087.537973:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1871271599201920:12345-0@lo:38:llog_process_th.0 Request processed in 176us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584087.537981:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784584087.538206:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424e00 x1871271599201920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584087.538217:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784584087.538225:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784584087.538232:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784584087.538237:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784584087.538239:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3048f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784584087.538245:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599201920:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784584087.539551:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1784584087.543443:0:19507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784584087.543512:0:19507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584087.543533:0:19507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584087.543546:0:19507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584087.543597:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584087.543600:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584087.543601:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584087.543602:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584087.543603:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584087.543605:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584087.543607:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584087.543608:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584087.543609:0:19507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584087.543613:0:19507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784584087.543615:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584087.543616:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584087.543618:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584087.543618:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584087.543684:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584087.543686:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584087.543686:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584087.543688:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584087.543689:0:19507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584087.543714:0:19507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784584087.543735:0:19507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599202048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584087.543873:0:19507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584087.543914:0:19507:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302862d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584087.544010:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202048 00000100:00100000:2.0:1784584087.544018:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202048 00000100:00100000:2.0:1784584087.544067:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784584087.544076:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599202048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784584087.544101:0:17180:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784584087.544114:0:17180:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784584087.548014:0:17180:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784584087.548032:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784584087.548131:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784584087.548136:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784584087.548162:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548182:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548189:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548197:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548238:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548251:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 24 pid: 17179 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584087.548266:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599202176:0@lo:104: 00000100:00100000:2.0:1784584087.548338:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584087.548382:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548390:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584087.548398:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599202304:0@lo:104: 00000100:00100000:2.0:1784584087.548417:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584087.548441:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584087.548461:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202176 00000100:00100000:2.0:1784584087.548461:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202304 00000100:00100000:2.0:1784584087.548479:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202304 00000100:00100000:3.0:1784584087.548480:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202176 00000100:00100000:2.0:1784584087.548520:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584087.548529:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599202304:12345-0@lo:104: 00010000:00010000:2.0:1784584087.548541:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.548586:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584087.548591:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599202304:12345-0@lo:104: Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584087.548598:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584087.550831:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584087.550848:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599202176:12345-0@lo:104: 00010000:00010000:3.0:1784584087.550867:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.551005:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584087.551013:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:17202:x1871271599202176:12345-0@lo:104: Request processed in 171us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.551020:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1784584087.555213:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584087.555228:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.555241:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cea00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584087.555246:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.555257:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584087.555265:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584087.555271:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584087.555318:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584087.555457:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.555465:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584087.555613:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.555634:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172cea00/0xdab2421a42e48cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48cdf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.555646:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584087.555648:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584087.555650:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584087.555705:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584087.555728:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599202432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584087.555794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584087.555865:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:19507:x1871271599202048:12345-0@lo:253:mount.lustre.0 Request processed in 11788us (11990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.555877:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202432 00000100:00100000:2.0:1784584087.555877:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784584087.555886:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202432 00010000:00010000:3.0:1784584087.555914:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584087.555944:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584087.555954:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3641:x1871271599202432:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584087.555965:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599202176:0@lo:104: 00010000:00010000:3.0:1784584087.555967:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584087.555977:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584087.555981:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1871271599202304:0@lo:104: 00010000:00010000:3.0:1784584087.555995:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.556007:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.556013:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ebd9c00/0xdab2421a42e48cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48cd8 expref: 24 pid: 17181 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584087.556028:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584087.556205:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584087.556208:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584087.556210:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584087.556256:0:19507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:19507:1871271599202048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784584087.556267:0:19507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784584087.556270:0:19507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584087.556272:0:19507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584087.556282:0:19507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584087.556284:0:19507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584087.556285:0:19507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584087.556286:0:19507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584087.556287:0:19507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584087.556289:0:19507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584087.556291:0:19507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784584087.556304:0:19507:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784584087.556437:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:3641:x1871271599202432:12345-0@lo:103:ldlm_bl.0 Request processed in 485us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584087.556444:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1784584087.556541:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.556549:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584087.556552:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.556560:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584087.556566:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584087.556572:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584087.556605:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.556611:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784584087.556727:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599202432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584087.557155:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557164:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce000/0xdab2421a42e48ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48ced expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557180:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584087.557182:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584087.557184:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584087.557219:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599202560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584087.557258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584087.557409:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202560 00000100:00100000:0.0:1784584087.557415:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202560 00010000:00010000:0.0:1784584087.557439:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 23 pid: 17179 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584087.557491:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584087.557500:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:3639:x1871271599202560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584087.557510:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584087.557515:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 23 pid: 17179 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557525:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 23 pid: 17179 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557537:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96800/0xdab2421a42e48ced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48ce6 expref: 23 pid: 17179 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557551:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557558:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784584087.557584:0:17172:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009448754s 00010000:00010000:0.0:1784584087.557588:0:17172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557596:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557601:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557607:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.557613:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584087.557617:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.558111:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.558133:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584087.558144:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584087.558194:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3639:x1871271599202560:12345-0@lo:103:ldlm_bl.0 Request processed in 695us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584087.558202:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1784584087.558260:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.558269:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584087.558285:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48d6b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584087.558423:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599202560:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1784584087.575658:0:19507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784584087.589192:0:19507:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784584087.589201:0:19507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784584087.589238:0:19507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784584087.589286:0:19507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784584087.589307:0:19507:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1784584087.589326:0:19507:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1784584087.590328:0:19507:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584087.590601:0:19507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584088.181885:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784584088.552900:0:19575:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584088.553187:0:19575:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584089.199800:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784584089.268950:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784584089.268957:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b437661000 from 10 10000000:01000000:0.0:1784584089.268962:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784584089.269016:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584089.269028:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584089.269039:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584089.269064:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784584089.269133:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584089.269177:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584089.269241:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202688 00000100:00100000:3.0:1784584089.269249:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202688 00000100:00100000:3.0:1784584089.270508:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784584089.270522:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599202688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584089.270537:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584089.270559:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b97400/0xdab2421a42e48d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48d72 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.270589:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b97400/0xdab2421a42e48d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48d72 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.270600:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b97400/0xdab2421a42e48d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d72 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.270609:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b97400, rc 0) 00000100:00100000:3.0:1784584089.270700:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599202688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584089.270706:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784584089.272542:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584089.272570:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584089.272582:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584089.272656:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784584089.274679:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584089.274724:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784584089.274854:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202816 00000100:00100000:3.0:1784584089.274939:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202816 00000100:00100000:3.0:1784584089.275098:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784584089.275109:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599202816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584089.275133:0:17180:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584089.275149:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584089.275153:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1784584089.275287:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599202816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584089.275294:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784584089.275398:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584089.275465:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584089.275488:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584089.275498:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584089.275508:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784584089.275510:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b3041fd000 from 10 10000000:01000000:0.0:1784584089.275513:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784584089.275542:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584089.275550:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584089.275560:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584089.275587:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784584089.275620:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584089.275644:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584089.277256:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599202944 00000100:00100000:3.0:1784584089.277345:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599202944 00000100:00100000:3.0:1784584089.277556:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784584089.277567:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599202944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584089.277584:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584089.277675:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b403b96a00/0xdab2421a42e48d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48d80 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.277774:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b403b96a00/0xdab2421a42e48d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48d80 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.277786:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b403b96a00/0xdab2421a42e48d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d80 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584089.277795:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b403b96a00, rc 0) 00000100:00100000:3.0:1784584089.277884:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599202944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584089.277891:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784584089.277919:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599202944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584089.277939:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584089.277949:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584089.278305:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599203072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784584089.278349:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584089.278387:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784584089.278444:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203072 00000100:00100000:3.0:1784584089.278457:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203072 00000100:00100000:3.0:1784584089.278665:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784584089.278674:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599203072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584089.278690:0:17180:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584089.278705:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584089.278708:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1784584089.279151:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599203072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 476us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584089.279161:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784584089.279543:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599203072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784584089.279616:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784584089.279625:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584089.279636:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584089.650750:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784584090.221703:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584090.286437:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599203200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784584090.286520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584090.286611:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203200 00000100:00100000:3.0:1784584090.286620:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203200 00000100:00100000:3.0:1784584090.286699:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584090.286717:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599203200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784584090.286755:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784584090.286823:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599203200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584090.286831:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784584090.286896:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584090.287608:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303960000 x1871271599203200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584090.287630:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599203200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784584091.246753:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584091.309862:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599203328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584091.309930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584091.309983:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203328 00000100:00100000:0.0:1784584091.309990:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203328 00000100:00100000:0.0:1784584091.310034:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784584091.310043:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599203328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784584091.310074:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584091.310119:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599203328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584091.310126:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784584091.310333:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599203328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584091.313402:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599203456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584091.313495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584091.314227:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203456 00000100:00100000:1.0:1784584091.314236:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203456 00000100:00100000:1.0:1784584091.314301:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784584091.314312:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599203456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784584091.314349:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784584091.316612:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599203456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2291us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584091.316626:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584091.316778:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599203456:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1784584092.206593:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784584092.269604:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584092.655350:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584072/real 1784584072] req@ffff98b303963480 x1871271599189248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.655382:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b303963480 x1871271599189248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.655409:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584072/real 1784584072] req@ffff98b303961500 x1871271599189376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.655422:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b303961500 x1871271599189376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584092.655440:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584092.655517:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584092.655521:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599189248:0@lo:8:kworker.0 00000100:00080000:1.0:1784584092.655527:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584092.655678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584092.655682:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584092.655685:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584092.655690:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1784584092.655695:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784584092.655702:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b43cb07800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584092.655721:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302424e00 x1871271599203840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584092.655730:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584092.655733:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584092.655735:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584092.655738:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1784584092.655740:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784584092.655743:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b43e8cb800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584092.655752:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef19f80 x1871271599203968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584092.655797:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584092.655800:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584092.655801:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584092.655806:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b302bd1800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584092.655816:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43ef18e00 x1871271599204480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584092.655864:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599203712:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.655925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.655963:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599204608:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.655987:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656020:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599205120:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656066:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784584092.656072:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599203584:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656117:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599204352:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656154:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599204992:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656194:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599204224:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656229:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599204864:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656288:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784584092.656294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599204096:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656326:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599204736:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.656365:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203712 00000100:00100000:2.0:1784584092.656372:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203712 00000100:00100000:2.0:1784584092.656412:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204224 00000100:00100000:2.0:1784584092.656416:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204224 00000100:00100000:2.0:1784584092.656432:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584092.656439:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599203712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656515:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599203712:12345-0@lo:400:kworker.0 Request processed in 76us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656523:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584092.656537:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584092.656543:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599204224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656573:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599204224:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656578:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584092.656594:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204608 00000100:00100000:2.0:1784584092.656597:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204608 00000100:00100000:2.0:1784584092.656611:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205120 00000100:00100000:2.0:1784584092.656613:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205120 00000100:00100000:2.0:1784584092.656633:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204992 00000100:00100000:2.0:1784584092.656636:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204992 00000100:00100000:2.0:1784584092.656649:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204864 00000100:00100000:2.0:1784584092.656652:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204864 00000100:00100000:2.0:1784584092.656661:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204096 00000100:00100000:2.0:1784584092.656663:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204096 00000100:00100000:2.0:1784584092.656683:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204736 00000100:00100000:2.0:1784584092.656686:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204736 00000100:00100000:2.0:1784584092.656697:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584092.656702:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599204608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656732:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599204608:12345-0@lo:400:kworker.0 Request processed in 30us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656737:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584092.656747:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584092.656752:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599205120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656773:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599205120:12345-0@lo:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656779:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584092.656788:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584092.656793:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599204992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656818:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871271599204992:12345-0@lo:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656823:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584092.656833:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584092.656839:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599204864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656879:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599204864:12345-0@lo:400:kworker.0 Request processed in 41us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656885:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584092.656896:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584092.656901:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599204096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656920:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599204096:12345-0@lo:400:kworker.0 Request processed in 20us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656935:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584092.656946:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584092.656951:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599204736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.656978:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599204736:12345-0@lo:400:kworker.0 Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.656983:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584092.657005:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203584 00000100:00100000:2.0:1784584092.657008:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203584 00000100:00100000:2.0:1784584092.657033:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784584092.657038:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3640:x1871271599203584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.657066:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3640:x1871271599203584:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.657072:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784584092.657098:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204352 00000100:00100000:2.0:1784584092.657101:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204352 00000100:00100000:2.0:1784584092.657126:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584092.657132:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599204352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.657159:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599204352:12345-0@lo:400:kworker.0 Request processed in 28us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.657165:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784584092.657190:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584092.657194:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584092.657196:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784584092.657226:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef1a300 x1871271599204096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657252:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599204096:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657275:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b40921bb80 x1871271599204736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657283:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b40921bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599204736:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.657293:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599204224:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657301:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80f800 x1871271599204864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657309:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599204864:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.657345:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599203584:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657354:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef1b800 x1871271599204352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657362:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599204352:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657372:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80d180 x1871271599204992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657380:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599204992:0@lo:400:kworker.0 00000100:00100000:2.0:1784584092.657390:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599203712:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657400:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef1bb80 x1871271599204608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657407:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599204608:0@lo:400:kworker.0 00010000:00080000:2.0:1784584092.657416:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80d880 x1871271599205120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.657424:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599205120:0@lo:400:kworker.0 00000100:00080000:1.0:1784584092.657866:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584092.657873:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599189376:0@lo:8:kworker.0 00000100:00100000:1.0:1784584092.657896:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599203840:0@lo:8:kworker.0 00000100:00100000:1.0:1784584092.657934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584092.658280:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599203968:0@lo:8:kworker.0 00000100:00100000:1.0:1784584092.658306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584092.658630:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599204480:0@lo:8:kworker.0 00000100:00100000:1.0:1784584092.658658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584092.658711:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203840 00000100:00100000:3.0:1784584092.658718:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203840 00000100:00100000:3.0:1784584092.658863:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599203968 00000100:00100000:3.0:1784584092.658867:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599203968 00000100:00100000:3.0:1784584092.658900:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599204480 00000100:00100000:3.0:1784584092.658903:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599204480 00000100:00100000:3.0:1784584092.658915:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584092.658921:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599203968:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784584092.658951:0:18692:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1784584092.658980:0:18692:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48d8e 00002000:00100000:3.0:1784584092.659151:0:18692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98b301f90000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784584092.659156:0:18692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1784584092.659159:0:18692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784584092.659329:0:18692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784584092.659353:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b301f97000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584092.659416:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599203968:12345-0@lo:8:kworker.0 Request processed in 493us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.659423:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584092.659443:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584092.659447:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599204480:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784584092.659463:0:18692:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1784584092.659500:0:18692:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e48d95 00002000:00100000:3.0:1784584092.659509:0:18692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98b301f91000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1784584092.659512:0:18692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1784584092.659514:0:18692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784584092.659537:0:18692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1784584092.659551:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b301f95000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584092.659581:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599204480:12345-0@lo:8:kworker.0 Request processed in 131us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.659587:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784584092.659682:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef19f80 x1871271599203968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.659693:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584092.659700:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784584092.659707:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784584092.659712:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784584092.659715:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784584092.659743:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784584092.659749:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599203968:0@lo:8:kworker.0 00010000:00080000:1.0:1784584092.659764:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43ef18e00 x1871271599204480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584092.659773:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1784584092.659778:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784584092.659780:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784584092.659783:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784584092.659796:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784584092.659799:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599204480:0@lo:8:kworker.0 00000004:00080000:1.0:1784584092.659823:0:17212:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784584092.659895:0:17212:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535845426973ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784584092.659902:0:17212:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784584092.659923:0:17930:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784584092.659963:0:17930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 535845495162ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784584092.659968:0:17930:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784584092.660923:0:17213:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1784584092.660947:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1871271599205376:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784584092.661305:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584092.661346:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302862180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584092.661365:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584092.661378:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584092.661416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584092.661446:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205248 00000100:00100000:3.0:1784584092.661452:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205248 00000100:00100000:3.0:1784584092.661518:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584092.661527:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599205248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784584092.661552:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784584092.661603:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599205248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.661610:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784584092.661630:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584092.661643:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205376 00000100:00100000:3.0:1784584092.661646:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205376 00000100:00100000:3.0:1784584092.661666:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584092.661672:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17213:x1871271599205376:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1784584092.661867:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b42f7cce00 x1871271599205248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584092.661885:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599205248:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1784584092.664633:0:18692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1784584092.664645:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1784584092.664650:0:18692:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:1.0:1784584092.665881:0:17919:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1784584092.665907:0:17166:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1784584092.666751:0:17931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784584092.666780:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599205632:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1784584092.666846:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.666873:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584092.666887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584092.666897:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599205504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584092.666922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.666951:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205632 00000100:00100000:2.0:1784584092.666957:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205632 00000100:00100000:2.0:1784584092.668298:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584092.668315:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17931:x1871271599205632:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1784584092.674850:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584092.674871:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205504 00000100:00100000:3.0:1784584092.674881:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205504 00000100:00100000:3.0:1784584092.674935:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584092.674944:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1871271599205504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784584092.674969:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784584092.675068:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1871271599205504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (8145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.675076:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00010000:3.0:1784584092.675951:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.675961:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.675978:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.675983:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.675990:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676007:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676018:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676026:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676045:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.676055:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.676060:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676067:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.676078:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676087:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676103:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676110:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5c82741/0xdab2421a42e48d9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.676127:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.676129:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.676130:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1784584092.677388:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43e80d880 x1871271599205504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.677413:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599205504:0@lo:13:osp-pre-1-1.0 00002000:00010000:3.0:1784584092.677937:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.677946:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.677960:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.677964:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.677970:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.677983:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.677993:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.678009:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.678030:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584092.678664:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584092.678671:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.678680:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.678685:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.678695:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.678724:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.678732:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e48da3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.678750:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.678752:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.678753:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784584092.678950:0:19378:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784584092.678957:0:19378:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784584092.679051:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17931:x1871271599205632:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10738us (12200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584092.679061:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584092.679095:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584092.679102:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1871271599203840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784584092.679136:0:19378:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1784584092.679165:0:19378:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e48daa 00002000:00100000:1.0:1784584092.679186:0:19378:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98b302464000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784584092.679191:0:19378:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784584092.679194:0:19378:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784584092.679270:0:19378:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784584092.679296:0:19378:0:(import.c:65:import_set_state_nolock()) ffff98b302462800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584092.679344:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599203840:12345-0@lo:8:kworker.0 Request processed in 241us (21409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584092.679351:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1784584092.679393:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302424e00 x1871271599203840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.679405:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584092.679414:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784584092.679422:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784584092.679426:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784584092.679429:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784584092.679442:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784584092.679447:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599203840:0@lo:8:kworker.0 00000004:00080000:1.0:1784584092.679527:0:17211:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1784584092.679547:0:17211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1871271599205888:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784584092.679578:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1784584092.679776:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.679784:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679796:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.679800:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.679806:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679819:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679828:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679836:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679852:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.679860:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.679865:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679878:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.679882:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679891:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679903:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679912:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48db1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.679927:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.679929:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.679931:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584092.680270:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599205632:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1784584092.680283:0:17931:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784584092.680304:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599206016:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784584092.680333:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.680353:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584092.680365:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584092.680375:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599205760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584092.680404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.680435:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205760 00000100:00100000:2.0:1784584092.680441:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205760 00000100:00100000:2.0:1784584092.680505:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584092.680512:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599205760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584092.680532:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584092.680569:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599205760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.680576:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1784584092.680685:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1784584092.680763:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.680769:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680780:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.680783:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.680788:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680809:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680818:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680826:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680841:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.680850:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.680854:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680862:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.680866:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680875:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680885:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680893:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48db8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.680913:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.680915:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.680916:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584092.681186:0:17211:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407480300 going to sleep for 11 seconds 00000004:00080000:1.0:1784584092.681203:0:17210:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784584092.681272:0:17210:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 535866803362ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784584092.681278:0:17210:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784584092.681395:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599205888 00000100:00100000:1.0:1784584092.681401:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599205888 00000100:00100000:1.0:1784584092.681428:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206016 00000100:00100000:1.0:1784584092.681437:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206016 00000100:00100000:1.0:1784584092.681456:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584092.681464:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17211:x1871271599205888:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1784584092.681708:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303961f80 x1871271599205760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584092.681730:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599205760:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1784584092.682050:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.682057:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682068:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.682072:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.682078:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682090:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682099:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682107:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682124:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.682133:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.682137:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682157:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.682161:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682170:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682183:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682191:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48dbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682207:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.682208:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.682210:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584092.682855:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.682862:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682872:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.682876:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.682880:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682891:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682905:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682912:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.682937:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584092.683433:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584092.683440:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.683448:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.683453:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.683462:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.683493:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.683501:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000473d624f/0xdab2421a42e48dc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.683519:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.683521:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.683522:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584092.683820:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.683827:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.683837:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.683841:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.683846:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.683856:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.683863:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.683869:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.683901:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784584092.684056:0:17166:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1784584092.684912:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584092.684920:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.684942:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.684947:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.684957:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.684971:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.684979:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1df54b/0xdab2421a42e48dcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.684996:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.684998:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.684999:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.685164:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.685171:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685181:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.685184:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.685189:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685201:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685208:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685216:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685239:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584092.685598:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.685604:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685613:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.685622:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.685627:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685637:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685645:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685651:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685667:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784584092.685963:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.685970:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685978:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.685981:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.685985:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.685994:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686002:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686015:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686029:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784584092.686154:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784584092.686160:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686168:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfc00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.686172:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686179:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686191:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686198:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007beee92b/0xdab2421a42e48dd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686212:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.686215:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686221:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cea00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.686224:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686253:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686265:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686271:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b007e96/0xdab2421a42e48ddb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686285:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.686288:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686294:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.686298:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686305:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686314:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686321:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a1f4574/0xdab2421a42e48de2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.686348:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.686350:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.686351:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.686613:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.686619:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686628:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.686631:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.686635:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686645:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686652:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686660:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686675:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584092.686926:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.686932:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686945:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.686948:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.686953:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686962:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686971:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686978:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.686987:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584092.687114:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.687119:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687126:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.687130:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687137:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687148:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687155:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d896b67f/0xdab2421a42e48de9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687167:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.687170:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687176:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ce00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.687184:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687192:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687201:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687208:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a79652/0xdab2421a42e48df0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687219:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.687221:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.687223:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.687408:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.687415:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687422:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.687425:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.687430:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687438:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687456:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687464:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687505:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.687628:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.687633:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687640:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1da00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.687644:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687652:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687663:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687678:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a478fdf6/0xdab2421a42e48df7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.687692:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.687694:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.687695:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.687883:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.687888:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687897:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.687901:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.687905:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687915:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687923:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687931:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.687963:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584092.688186:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.688191:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688200:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.688203:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.688207:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688217:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688224:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688231:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688251:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584092.688356:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.688361:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688369:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1de00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.688372:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688379:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688391:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688398:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000432d7737/0xdab2421a42e48dfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688411:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.688415:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688428:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1cc00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.688431:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688438:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688449:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688455:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eccf24db/0xdab2421a42e48e05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.688494:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.688496:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.688498:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.688689:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.688696:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688704:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.688712:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.688716:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688724:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688731:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688737:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.688785:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1784584092.688926:0:18693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1784584092.688934:0:18693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1784584092.688938:0:18693:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:1.0:1784584092.693322:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.693337:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.693355:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.693360:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.693366:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.693381:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.693392:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.693408:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693481:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.693490:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693498:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.693502:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693511:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693534:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693543:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b861440b/0xdab2421a42e48e0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693562:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.693565:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693572:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.693575:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693584:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693606:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.693614:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.693616:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.693618:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.694691:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.695660:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784584092.695670:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e48e13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.695990:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.696308:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.696316:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696328:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.696333:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.696339:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696353:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696362:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696369:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696400:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584092.696713:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.696718:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696726:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.696730:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.696734:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696742:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696749:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696756:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.696767:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784584092.696990:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.696996:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697004:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.697013:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.697018:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697027:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697035:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697041:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697049:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784584092.697296:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.697302:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697310:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.697312:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.697316:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697324:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697333:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697347:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697356:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784584092.697583:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784584092.697604:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697613:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.697618:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697627:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697643:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697650:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e48e1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697668:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784584092.697671:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697678:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.697681:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697689:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697712:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697718:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000669853a7/0xdab2421a42e48e21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697732:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.697735:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697741:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.697744:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697750:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697759:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697765:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a42a1346/0xdab2421a42e48e28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697780:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.697783:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697795:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.697799:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697806:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697817:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697823:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e48e2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.697836:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.697837:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.697839:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.697847:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.697979:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.697986:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.697995:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.697999:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.698003:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698014:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698022:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698029:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698053:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.698297:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.698303:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.698311:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1dc00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.698314:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.698322:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.698341:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.698348:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e95206b/0xdab2421a42e48e36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.698364:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.698366:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.698369:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.698700:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.698706:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698721:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.698724:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.698729:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698739:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698747:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698754:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.698769:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.699024:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.699029:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.699038:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.699042:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.699050:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.699061:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.699069:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e48e3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.699096:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.699098:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.699100:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.704737:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.705008:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.705186:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.705207:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.705220:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.705227:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.705253:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.705264:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.705272:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.705296:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784584092.706690:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.706701:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706716:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.706720:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.706726:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706739:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706748:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706757:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706775:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584092.706787:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.706793:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706813:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.706818:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706827:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706844:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706852:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e48e44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706868:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.706871:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706877:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.706880:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706887:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706898:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706910:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005256deea/0xdab2421a42e48e4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.706924:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.706926:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.706928:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584092.707658:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.707666:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.707678:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.707682:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.707687:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.707697:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.707705:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.707712:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.707851:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784584092.708371:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.708384:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.708394:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.708397:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.708402:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.708411:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.708418:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.708424:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708451:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584092.708457:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708465:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.708492:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708501:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708528:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708536:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e714f28b/0xdab2421a42e48e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708554:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.708557:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708564:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.708567:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708576:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708584:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.708601:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.708602:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.708604:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.709612:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584092.709699:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.709708:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.709723:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.709734:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.709740:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.709758:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.709768:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.709776:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.709801:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584092.710353:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.710361:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.710383:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.710388:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.710397:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.710413:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.710420:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.710440:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.710442:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.710444:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584092.710575:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.710581:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.710598:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.710602:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.710606:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.710617:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.710625:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.710640:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.710656:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584092.711290:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.711298:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711308:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.711311:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.711316:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711325:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711333:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711340:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711356:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584092.711365:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584092.711370:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711386:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.711390:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711399:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711412:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711420:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711434:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584092.711437:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711443:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.711447:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711454:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711461:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711495:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.711508:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.711510:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.711512:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.713687:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.713813:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784584092.713823:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b367b980/0xdab2421a42e48e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714295:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584092.714404:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584092.714410:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.714424:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1784584092.714428:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584092.714441:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.714455:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.714464:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.714500:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.714520:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1784584092.714559:0:18692:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:1.0:1784584092.714662:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.714668:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714677:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.714681:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714703:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714720:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714728:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c732b5c6/0xdab2421a42e48e75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.714746:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.714749:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.714751:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584092.714855:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17213:x1871271599205376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 53176us (53544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.714865:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584092.714895:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584092.714905:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17931:x1871271599206016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1784584092.714934:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1784584092.714974:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17931:x1871271599206016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72us (34640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584092.714980:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784584092.715063:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1871271599205376:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784584092.715076:0:17213:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1784584092.715115:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1871271599206144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784584092.715148:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584092.715173:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599206016:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784584092.715179:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039cf180 going to sleep for 11 seconds 00000004:00080000:0.0:1784584092.715187:0:17931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1784584092.715217:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599206272:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1784584092.715281:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206144 00000100:00100000:3.0:1784584092.715287:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206144 00000100:00100000:0.0:1784584092.715315:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584092.715326:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206272 00000100:00100000:3.0:1784584092.715330:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206272 00000100:00100000:0.0:1784584092.715338:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303af7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584092.715352:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584092.715368:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17213:x1871271599206144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784584092.715392:0:19378:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:0.0:1784584092.718229:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.718256:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.718273:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.718278:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.718289:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.718314:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.718325:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.718332:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.718353:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584092.719631:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.719640:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.719652:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.719656:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.719679:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.719700:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.719708:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d423bce/0xdab2421a42e48e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.719728:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.719730:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.719732:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.720011:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.720197:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720211:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.720214:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.720220:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720231:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720313:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720334:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720355:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584092.720504:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.720511:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.720519:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.720522:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.720531:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.720543:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.720563:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2576fa1/0xdab2421a42e48e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.720579:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.720581:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.720583:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.720916:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.720923:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720932:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.720935:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.720940:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720950:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720959:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720966:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.720988:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584092.721067:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584092.721074:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.721082:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.721086:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.721094:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.721105:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.721113:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c49d766/0xdab2421a42e48e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.721128:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.721130:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.721132:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.721366:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.721373:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721392:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.721395:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.721408:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721420:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721427:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721434:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721453:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584092.721591:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584092.721597:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721605:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.721609:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721617:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721641:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721648:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053259fc7/0xdab2421a42e48e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721662:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.721664:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.721666:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.721728:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.721734:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721743:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.721746:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.721751:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721761:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721769:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721777:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.721808:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784584092.722237:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.722255:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722264:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.722268:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.722273:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722283:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722291:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722299:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722314:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784584092.722430:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584092.722436:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722444:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.722455:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722464:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722544:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722550:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3d427d/0xdab2421a42e48e98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722562:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584092.722565:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722598:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.722601:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722607:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722616:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722623:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006030906e/0xdab2421a42e48e9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722642:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.722644:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.722647:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.722690:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.722696:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722704:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.722708:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.722712:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722723:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.722728:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.722731:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722739:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.722758:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784584092.723408:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.723416:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723438:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.723442:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.723447:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723456:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723463:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723494:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723508:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784584092.723625:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584092.723629:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723638:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.723642:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723650:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723674:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723682:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea874b8/0xdab2421a42e48ea6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723695:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584092.723698:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723704:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.723707:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723715:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723741:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723749:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009225274a/0xdab2421a42e48ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723766:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.723769:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.723780:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.723834:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.723840:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723849:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.723852:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.723856:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723866:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723875:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723882:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.723895:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.725693:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.725708:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.725721:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.725726:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.725737:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.725760:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.725768:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7151e54/0xdab2421a42e48eb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.725787:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.725789:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.725791:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.725797:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584092.725992:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584092.726011:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.726021:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1784584092.726026:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584092.726031:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.726043:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.726052:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.726058:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.726081:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584092.726107:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584092.726114:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.726124:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.726128:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.726151:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.726164:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.726172:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e48ebb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.726189:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.726192:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.726194:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.726985:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.727004:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727016:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.727020:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.727025:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727036:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727046:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727062:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727088:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.727298:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.727304:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.727324:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.727328:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.727337:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.727350:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.727358:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007af5b7d4/0xdab2421a42e48ec2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.727374:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.727375:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.727377:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584092.727451:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.727457:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727724:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.727728:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.727733:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727744:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727752:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727758:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.727809:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784584092.729256:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.729267:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.729288:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.729293:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.729299:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.729312:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.729321:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.729328:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735073:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.735089:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735103:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.735108:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735119:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735148:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735156:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730831e7/0xdab2421a42e48ec9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735202:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.735207:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735214:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.735217:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735225:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735235:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.735254:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.735255:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.735257:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.735332:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784584092.735340:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d9b736e/0xdab2421a42e48ed0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584092.736040:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584092.736049:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.736062:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1784584092.736067:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584092.736073:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.736098:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.736107:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.736115:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.736131:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584092.736404:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584092.736410:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.736418:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584092.736422:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.736431:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.736445:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.736452:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad7ba66/0xdab2421a42e48ed7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.736488:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.736490:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.736492:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784584092.740932:0:19508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1784584092.740991:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784584092.740997:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784584092.741144:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17213:x1871271599206144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25773us (25991us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784584092.741158:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584092.741188:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784584092.741199:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17931:x1871271599206272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1784584092.741251:0:19378:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:0.0:1784584092.741414:0:17213:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784584092.741422:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1871271599206144:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784584092.741436:0:17213:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:2.0:1784584092.742045:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.742054:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.742071:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.742076:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.742083:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.742097:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.742108:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.742116:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.742135:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.744407:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.744418:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.744441:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.744446:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.744456:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.744507:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.744515:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48ede lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.744533:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.744535:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.744537:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.744561:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584092.744861:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.744869:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.744879:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.744884:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.744890:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.744913:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.744923:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.744931:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.744955:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584092.747128:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.747139:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.747151:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.747155:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.747176:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.747194:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.747202:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48ee5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.747221:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.747223:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.747224:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584092.747357:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.747364:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.747375:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.747380:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.747386:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.747397:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.747406:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.747425:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.747984:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584092.748825:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.748833:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.748848:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.748852:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.748857:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.748870:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.748878:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.748886:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755082:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.755095:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755108:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.755113:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755124:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755146:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755167:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48eec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755186:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.755190:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755197:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.755200:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755208:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755218:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.755226:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.755228:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.755230:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.756407:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584092.756418:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e48ef3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584092.756890:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.756897:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.756910:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.756915:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.756922:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.756936:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.756945:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.756952:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.762858:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.762873:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.762887:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.762903:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.762914:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.762937:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.762996:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.762999:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.763007:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.763212:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584092.763221:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e48efa lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584092.763794:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.763801:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.763826:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.763830:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.763838:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.763853:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.763861:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.763869:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.769980:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.769991:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.770004:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.770009:0:19525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.770021:0:19525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.770042:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.770050:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.770051:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.770053:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584092.775269:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584092.775284:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc45d82/0xdab2421a42e48f01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.775879:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584092.776840:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.776850:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.776865:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.776870:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.776877:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.776906:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.776916:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.776923:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.776941:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584092.778033:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.778043:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.778057:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.778061:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.778066:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.778078:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.778087:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.778107:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.778124:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584092.778516:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584092.778525:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778535:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.778539:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778548:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778575:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778583:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501d014c/0xdab2421a42e48f08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778608:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584092.778612:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778618:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584092.778621:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778629:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778652:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778659:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e48f0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584092.778673:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.778675:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.778677:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584092.778684:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584092.780126:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17931:x1871271599206272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 38923us (64804us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784584092.780138:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784584092.780204:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17931:1871271599206272:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1784584092.780219:0:17931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1784584092.780274:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17931:1871271599206400:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784584092.780308:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584092.780337:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584092.780368:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206400 00000100:00100000:1.0:1784584092.780375:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206400 00000100:00100000:1.0:1784584092.780415:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584092.780423:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17931:x1871271599206400:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784584092.780483:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17931:x1871271599206400:12345-0@lo:900:osp-pre-1-1.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584092.780489:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784584092.780517:0:17931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303962d80 x1871271599206400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584108 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584092.780527:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303962d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17931:1871271599206400:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1784584092.780682:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.780690:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.780705:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.780710:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.780716:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.780730:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.780739:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.780747:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.780769:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584092.781463:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584092.783052:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.783082:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1784584092.783086:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584092.783093:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.783109:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.783119:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.783127:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584092.783150:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1784584092.783228:0:18693:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1784584092.783324:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17211:x1871271599205888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101857us (103741us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584092.783334:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584092.783386:0:17211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1871271599205888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784584092.783402:0:17211:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1784584092.783444:0:17211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1871271599206528:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784584092.783501:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584092.783523:0:17211:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584092.783549:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206528 00000100:00100000:2.0:1784584092.783554:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206528 00000100:00100000:2.0:1784584092.783589:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584092.783597:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17211:x1871271599206528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784584092.783630:0:18694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1784584092.784193:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584092.784202:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.784213:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584092.784217:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.784227:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787375:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584092.787388:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787401:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584092.787406:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787417:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787436:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787444:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e48f1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584092.787464:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.787480:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584092.787483:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.787689:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.787699:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfd7e2e/0xdab2421a42e48f16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584092.787728:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.787730:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584092.787731:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584092.801136:0:18688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1784584092.801175:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784584092.809060:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17211:x1871271599206528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25455us (25550us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784584092.809075:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584092.811900:0:17211:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1784584092.811915:0:17211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43e80f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1871271599206528:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784584092.811931:0:17211:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000001:02000400:0.0:1784584092.991646:0:19865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784584093.297179:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584093.850921:0:19917:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584093.851342:0:19917:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584094.317605:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584094.584209:0:19967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584094.584459:0:19967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784584094.803735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.804161:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257280 00000100:00100000:3.0:1784584094.804171:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257280 00000100:00100000:3.0:1784584094.804223:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:3.0:1784584094.804246:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1871271580257280:12345-192.168.203.51@tcp:250:mount.lustre.0 00010000:00080000:3.0:1784584094.804274:0:17180:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b7f5b5a8-62e4-4072-a0ec-35ae69338ffe@192.168.203.51@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:3.0:1784584094.804305:0:17180:0:(genops.c:1406:class_connect()) connect: client b7f5b5a8-62e4-4072-a0ec-35ae69338ffe, cookie 0xdab2421a42e48f24 00000100:00080000:3.0:1784584094.804427:0:17180:0:(import.c:65:import_set_state_nolock()) ffff98b301f91800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584094.804525:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+5:2397:x1871271580257280:12345-192.168.203.51@tcp:250:mount.lustre.0 Request processed in 282us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.804534:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1784584094.819786:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.820279:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257408 00000100:00100000:2.0:1784584094.820290:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257408 00000100:00100000:2.0:1784584094.820350:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:2.0:1784584094.820360:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+5:14921:x1871271580257408:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784584094.820378:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584094.820395:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee661 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.820421:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee661 expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.820432:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee661 expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.820440:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1600, rc 0) 00000100:00100000:2.0:1784584094.820545:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+6:14921:x1871271580257408:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 186us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.820552:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1784584094.831370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.831458:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257536 00000100:00100000:3.0:1784584094.831515:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257536 00000100:00100000:3.0:1784584094.831571:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:3.0:1784584094.831661:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+6:14921:x1871271580257536:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584094.831984:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+6:14921:x1871271580257536:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 325us (622us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584094.839044:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:0.0:1784584094.839345:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.839490:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257664 00000100:00100000:2.0:1784584094.839500:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257664 00000100:00100000:2.0:1784584094.839552:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:2.0:1784584094.839562:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+6:14921:x1871271580257664:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784584094.839579:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584094.839596:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c0800/0xdab2421a42e48f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee668 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.839622:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c0800/0xdab2421a42e48f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee668 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.839634:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c0800/0xdab2421a42e48f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee668 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584094.839644:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0800, rc 0) 00000100:00100000:2.0:1784584094.840338:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+7:14921:x1871271580257664:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 772us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.840347:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:0.0:1784584094.847771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.847987:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257792 00000100:00100000:3.0:1784584094.847997:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257792 00000100:00100000:3.0:1784584094.848056:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:3.0:1784584094.848067:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+7:14921:x1871271580257792:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584094.848237:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14921:x1871271580257792:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 162us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.848245:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:1.0:1784584094.850025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.850114:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580257920 00000100:00100000:2.0:1784584094.850123:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580257920 00000100:00100000:2.0:1784584094.850178:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:2.0:1784584094.850187:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14921:x1871271580257920:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784584094.850343:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14921:x1871271580257920:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.850351:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:1.0:1784584094.859865:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.863028:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258048 00000100:00100000:3.0:1784584094.863043:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258048 00000100:00100000:3.0:1784584094.863110:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1784584094.863119:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258048:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584094.863303:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258048:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 184us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.863311:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1784584094.894745:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584094.894845:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258176 00000100:00100000:0.0:1784584094.894855:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258176 00000100:00100000:0.0:1784584094.894911:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:0.0:1784584094.894922:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258176:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584094.895073:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258176:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584094.895082:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:1.0:1784584094.906727:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.906951:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258304 00000100:00100000:2.0:1784584094.906961:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258304 00000100:00100000:2.0:1784584094.907049:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:2.0:1784584094.907060:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258304:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584094.907218:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14940:x1871271580258304:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 159us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.907237:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:1.0:1784584094.912254:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.912388:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258432 00000100:00100000:3.0:1784584094.912397:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258432 00000100:00100000:3.0:1784584094.912553:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1784584094.912564:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:14921:x1871271580258432:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584094.912607:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584094.912625:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982800/0xdab2421a42e48f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee699 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.912662:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982800/0xdab2421a42e48f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee699 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.912674:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982800/0xdab2421a42e48f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee699 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.912683:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982800, rc 0) 00000100:00100000:3.0:1784584094.912743:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+9:14921:x1871271580258432:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 181us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.912751:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:0.0:1784584094.922425:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.922739:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258560 00000100:00100000:2.0:1784584094.922748:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258560 00000100:00100000:2.0:1784584094.922836:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:2.0:1784584094.922846:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+9:14921:x1871271580258560:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784584094.922871:0:17179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784584094.922895:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784584094.922900:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784584094.922903:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784584094.922906:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784584094.922909:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1784584094.924566:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+9:14921:x1871271580258560:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 1713us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.924586:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:1.0:1784584094.928149:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.928213:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258688 00000100:00100000:3.0:1784584094.928223:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258688 00000100:00100000:3.0:1784584094.928291:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:3.0:1784584094.928301:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+9:14921:x1871271580258688:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584094.928318:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584094.928335:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee6a0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.928363:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.928375:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584094.928400:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983000, rc 0) 00000100:00100000:3.0:1784584094.928457:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14921:x1871271580258688:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.928500:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:3.0:1784584094.930192:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.930342:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258816 00000100:00100000:2.0:1784584094.930352:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258816 00000100:00100000:2.0:1784584094.930402:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:2.0:1784584094.930418:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14921:x1871271580258816:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784584094.930609:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14921:x1871271580258816:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 197us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.930618:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:1.0:1784584094.932545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584094.932739:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580258944 00000100:00100000:0.0:1784584094.932748:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580258944 00000100:00100000:0.0:1784584094.932803:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:0.0:1784584094.932813:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14921:x1871271580258944:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784584094.932985:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14921:x1871271580258944:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 172us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584094.932994:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:1.0:1784584094.935621:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.935763:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259072 00000100:00100000:3.0:1784584094.935772:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259072 00000100:00100000:3.0:1784584094.935817:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:3.0:1784584094.935826:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14945:x1871271580259072:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584094.935974:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14945:x1871271580259072:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 147us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.935982:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:3.0:1784584094.941806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.942123:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259200 00000100:00100000:2.0:1784584094.942146:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259200 00000100:00100000:2.0:1784584094.942208:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:2.0:1784584094.942223:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14945:x1871271580259200:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584094.942382:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:14945:x1871271580259200:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 160us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.942390:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:1.0:1784584094.954889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584094.954953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.957050:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259328 00000100:00100000:3.0:1784584094.957063:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259328 00000100:00100000:3.0:1784584094.957149:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259584 00000100:00100000:3.0:1784584094.957153:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259584 00000100:00100000:3.0:1784584094.957185:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584094.957193:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1871271580259328:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584094.957222:0:17188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744@192.168.203.51@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1784584094.957459:0:17188:0:(genops.c:1406:class_connect()) connect: client c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744, cookie 0xdab2421a42e48f47 00000004:00100000:3.0:1784584094.957500:0:17188:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584094.957745:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b43ed14800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584094.957880:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1784584094.957888:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1871271580259584:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784584094.957910:0:18716:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744@192.168.203.51@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1784584094.957943:0:18716:0:(genops.c:1406:class_connect()) connect: client c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744, cookie 0xdab2421a42e48f4e 00000004:00100000:0.0:1784584094.957959:0:18716:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784584094.958090:0:18716:0:(import.c:65:import_set_state_nolock()) ffff98b30340b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584094.958209:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2397:x1871271580259328:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 1012us (3749us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584094.958239:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2397:x1871271580259584:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 316us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584094.958263:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584094.958493:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584094.964313:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.965465:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259840 00000100:00100000:2.0:1784584094.965517:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259840 00000100:00100000:2.0:1784584094.965592:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784584094.965603:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580259840:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584094.965638:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784584094.965740:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580259840:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 138us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.965747:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00080000:3.0:1784584094.965829:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584094.966801:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584094.966995:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259456 00000100:00100000:3.0:1784584094.967003:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259456 00000100:00100000:3.0:1784584094.967053:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1784584094.967070:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:0:x1871271580259456:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784584094.967099:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584094.967152:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:0:x1871271580259456:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.967160:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784584094.973957:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.974069:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259968 00000100:00100000:2.0:1784584094.974080:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259968 00000100:00100000:2.0:1784584094.974142:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1784584094.974154:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580259968:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784584094.974261:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580259968:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584094.974269:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1784584094.978288:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584094.978371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584094.978399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584094.978432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584094.978491:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580259712 00000100:00100000:1.0:1784584094.978500:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580259712 00000100:00100000:1.0:1784584094.978559:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:1.0:1784584094.978585:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:0:x1871271580259712:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784584094.978647:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584094.978725:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:0:x1871271580259712:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 157us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584094.978744:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00080000:1.0:1784584094.978765:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584094.978976:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260096 00000100:00100000:3.0:1784584094.978982:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260096 00000100:00100000:3.0:1784584094.979009:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260224 00000100:00100000:3.0:1784584094.979012:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260224 00000100:00100000:3.0:1784584094.979030:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784584094.979035:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580260096:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784584094.979060:0:18693:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744@192.168.203.51@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1784584094.979088:0:18693:0:(genops.c:1406:class_connect()) connect: client c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744, cookie 0xdab2421a42e48f55 00002000:00100000:3.0:1784584094.979100:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744/ffff98b302b96000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784584094.979117:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784584094.979281:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784584094.979308:0:18693:0:(import.c:65:import_set_state_nolock()) ffff98b302b96800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584094.979344:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2397:x1871271580260096:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 308us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.979351:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784584094.979375:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584094.979380:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1871271580260224:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784584094.979396:0:18693:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744@192.168.203.51@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1784584094.979424:0:18693:0:(genops.c:1406:class_connect()) connect: client c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744, cookie 0xdab2421a42e48f5c 00002000:00100000:3.0:1784584094.979431:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744/ffff98b302b92000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784584094.979442:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784584094.979566:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784584094.979582:0:18693:0:(import.c:65:import_set_state_nolock()) ffff98b302b92800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584094.979606:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2397:x1871271580260224:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 225us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584094.979613:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1784584094.980382:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260352 00000100:00100000:0.0:1784584094.980390:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260352 00000100:00100000:0.0:1784584094.980497:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1784584094.980506:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580260352:12345-192.168.203.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784584094.980557:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580260352:12345-192.168.203.51@tcp:900:mount.lustre.0 Request processed in 53us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584094.980579:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784584094.986879:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584094.987164:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260480 00000100:00100000:2.0:1784584094.987175:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260480 00000100:00100000:2.0:1784584094.987277:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584094.987288:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580260480:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784584094.988599:0:17189:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1210us 00000004:00200000:1.0:1784584095.002785:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784584095.002918:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14921:x1871271580260480:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 15628us (16043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584095.002935:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584095.218540:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584095.224211:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260608 00000100:00100000:1.0:1784584095.224239:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260608 00000100:00100000:1.0:1784584095.224362:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1784584095.224373:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:14968:x1871271580260608:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:1.0:1784584095.224392:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584095.224418:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1da00/0xdab2421a42e48f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee6d1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224509:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224523:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224536:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584095.224597:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584095.224602:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584095.224633:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224659:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1da00/0xdab2421a42e48f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d1 expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224678:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d1 expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584095.224686:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:1.0:1784584095.224689:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584095.224692:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1de00, rc 0) 00000100:00100000:1.0:1784584095.224754:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:14968:x1871271580260608:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 382us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584095.224761:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00010000:00010000:1.0:1784584095.342714:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584095.405782:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599206656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784584095.405850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584095.406090:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206656 00000100:00100000:1.0:1784584095.406097:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206656 00000100:00100000:1.0:1784584095.406167:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584095.406179:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599206656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784584095.406200:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584095.406258:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599206656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00080000:3.0:1784584095.406259:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584095.406266:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584095.406355:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599206656:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784584096.369268:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584096.429690:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599206784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584096.429761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584096.429830:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206784 00000100:00100000:0.0:1784584096.429839:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206784 00000100:00100000:0.0:1784584096.429905:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784584096.429914:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599206784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784584096.429950:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584096.430002:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599206784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584096.430010:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584096.430060:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599206784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584096.430280:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584096.430289:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599206912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584096.430317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584096.430384:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599206912 00000100:00100000:3.0:1784584096.430389:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599206912 00000100:00100000:3.0:1784584096.430422:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784584096.430429:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599206912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584096.430447:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584096.430532:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599206912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584096.430539:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584096.432109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599206912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584097.279044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.279147:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260736 00000100:00100000:3.0:1784584097.279158:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260736 00000100:00100000:3.0:1784584097.279253:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:3.0:1784584097.279263:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15020:x1871271580260736:12345-192.168.203.51@tcp:41:lfs.0 00000004:00000024:3.0:1784584097.279298:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584097.279382:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15020:x1871271580260736:12345-192.168.203.51@tcp:41:lfs.0 Request processed in 121us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.279390:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00080000:0.0:1784584097.279689:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584097.285989:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.288355:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260864 00000100:00100000:0.0:1784584097.288370:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260864 00000100:00100000:0.0:1784584097.288549:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1784584097.288571:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580260864:12345-192.168.203.51@tcp:41:lfs.0 00000004:00000024:0.0:1784584097.288609:0:18716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584097.288893:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580260864:12345-192.168.203.51@tcp:41:lfs.0 Request processed in 333us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.288901:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00080000:3.0:1784584097.291221:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584097.299208:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584097.299363:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580260992 00000100:00100000:1.0:1784584097.299385:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580260992 00000100:00100000:1.0:1784584097.299464:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584097.299505:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580260992:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:1.0:1784584097.299538:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584097.299618:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580260992:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 115us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584097.299625:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:3.0:1784584097.300450:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584097.303784:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.303868:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261120 00000100:00100000:3.0:1784584097.303878:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261120 00000100:00100000:3.0:1784584097.303948:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584097.303959:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580261120:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:3.0:1784584097.303991:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784584097.304071:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15020:x1871271580261120:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.304079:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00080000:0.0:1784584097.304970:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784584097.389767:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584097.491586:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.491777:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261248 00000100:00100000:0.0:1784584097.491859:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261248 00000100:00100000:0.0:1784584097.491926:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:0.0:1784584097.491937:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:15049:x1871271580261248:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584097.491956:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584097.491978:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e48f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee6d8 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.492008:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e48f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d8 expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.492021:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e48f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d8 expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.492031:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9e00, rc 0) 00000100:00100000:0.0:1784584097.492092:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580261248:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 156us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.492099:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:2.0:1784584097.499965:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.504587:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261376 00000100:00100000:0.0:1784584097.504603:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261376 00000100:00100000:0.0:1784584097.504681:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:0.0:1784584097.504692:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580261376:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784584097.504855:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580261376:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 164us (4897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.504863:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:2.0:1784584097.516806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.516901:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261504 00000100:00100000:0.0:1784584097.516910:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261504 00000100:00100000:0.0:1784584097.516968:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:0.0:1784584097.516992:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580261504:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784584097.517147:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580261504:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.517154:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:2.0:1784584097.530492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.531655:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261632 00000100:00100000:3.0:1784584097.531668:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261632 00000100:00100000:3.0:1784584097.531741:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:3.0:1784584097.531752:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261632:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584097.531915:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261632:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 164us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.531923:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:1.0:1784584097.582090:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.582356:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261760 00000100:00100000:2.0:1784584097.582367:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261760 00000100:00100000:2.0:1784584097.582428:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:2.0:1784584097.582438:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261760:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584097.582630:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261760:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 192us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.582757:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:2.0:1784584097.619723:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.619879:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580261888 00000100:00100000:0.0:1784584097.619890:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580261888 00000100:00100000:0.0:1784584097.619940:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:0.0:1784584097.619948:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261888:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584097.620078:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15058:x1871271580261888:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 130us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.620086:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:1.0:1784584097.625328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.625416:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262016 00000100:00100000:3.0:1784584097.625426:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262016 00000100:00100000:3.0:1784584097.625504:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:3.0:1784584097.625513:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:15049:x1871271580262016:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584097.625543:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584097.625566:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983800/0xdab2421a42e48f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee709 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584097.625594:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983800/0xdab2421a42e48f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee709 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584097.625605:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983800/0xdab2421a42e48f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee709 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584097.625613:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983800, rc 0) 00000100:00100000:3.0:1784584097.625672:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:15049:x1871271580262016:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.625678:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:1.0:1784584097.635921:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.636016:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262144 00000100:00100000:2.0:1784584097.636026:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262144 00000100:00100000:2.0:1784584097.636080:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:2.0:1784584097.636088:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:15049:x1871271580262144:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784584097.636121:0:17179:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784584097.636143:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784584097.636147:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784584097.636149:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784584097.636152:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784584097.636154:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784584097.638893:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:15049:x1871271580262144:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 2795us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.638907:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:1.0:1784584097.643901:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.643993:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262272 00000100:00100000:0.0:1784584097.644004:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262272 00000100:00100000:0.0:1784584097.644058:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:0.0:1784584097.644068:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:15049:x1871271580262272:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584097.644084:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584097.644113:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee710 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.644142:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.644153:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584097.644174:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8800, rc 0) 00000100:00100000:0.0:1784584097.644610:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15049:x1871271580262272:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 171us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.644618:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:1.0:1784584097.648652:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.648843:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262400 00000100:00100000:0.0:1784584097.648854:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262400 00000100:00100000:0.0:1784584097.648911:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:0.0:1784584097.648920:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15049:x1871271580262400:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784584097.649070:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15049:x1871271580262400:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.649078:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:2.0:1784584097.651096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.651323:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262528 00000100:00100000:3.0:1784584097.651334:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262528 00000100:00100000:3.0:1784584097.651387:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:3.0:1784584097.651396:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15049:x1871271580262528:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784584097.651582:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15049:x1871271580262528:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 186us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.651592:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:1.0:1784584097.657118:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.658286:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262656 00000100:00100000:0.0:1784584097.658298:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262656 00000100:00100000:0.0:1784584097.658363:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:0.0:1784584097.658373:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15064:x1871271580262656:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584097.658561:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15064:x1871271580262656:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 189us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.658570:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:1.0:1784584097.667697:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.667822:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262784 00000100:00100000:2.0:1784584097.667832:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262784 00000100:00100000:2.0:1784584097.667884:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:2.0:1784584097.667893:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15064:x1871271580262784:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584097.668021:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:15064:x1871271580262784:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.668029:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:2.0:1784584097.690934:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.691022:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584097.691300:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580262912 00000100:00100000:3.0:1784584097.691310:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580262912 00000100:00100000:3.0:1784584097.691351:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263168 00000100:00100000:3.0:1784584097.691354:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263168 00000100:00100000:3.0:1784584097.691378:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784584097.691387:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b40921bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1871271580262912:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584097.691433:0:17188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec83902b-e7e6-476f-9537-00c010e7ce56@192.168.203.51@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1784584097.691499:0:17188:0:(genops.c:1406:class_connect()) connect: client ec83902b-e7e6-476f-9537-00c010e7ce56, cookie 0xdab2421a42e48f86 00000004:00100000:3.0:1784584097.691525:0:17188:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584097.691624:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b302b97800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584097.691711:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b40921bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2397:x1871271580262912:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 323us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.691720:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784584097.691737:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584097.691742:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1871271580263168:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584097.691757:0:17188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from ec83902b-e7e6-476f-9537-00c010e7ce56@192.168.203.51@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1784584097.691780:0:17188:0:(genops.c:1406:class_connect()) connect: client ec83902b-e7e6-476f-9537-00c010e7ce56, cookie 0xdab2421a42e48f8d 00000004:00100000:3.0:1784584097.691793:0:17188:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584097.691840:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b43ca68800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584097.691865:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2397:x1871271580263168:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 122us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584097.691872:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784584097.711974:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584097.712011:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584097.712041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.712130:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263424 00000100:00100000:2.0:1784584097.712138:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263424 00000100:00100000:2.0:1784584097.712218:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263040 00000100:00100000:2.0:1784584097.712221:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263040 00000100:00100000:2.0:1784584097.712233:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263296 00000100:00100000:2.0:1784584097.712265:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263296 00000100:00100000:2.0:1784584097.712294:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784584097.712304:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+7:15049:x1871271580263424:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584097.712336:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784584097.712405:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+7:15049:x1871271580263424:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.712413:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784584097.712432:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584097.712438:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:0:x1871271580263040:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584097.712449:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784584097.712514:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:0:x1871271580263040:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 75us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.712522:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584097.712536:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784584097.712543:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:0:x1871271580263296:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584097.712565:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584097.712596:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:0:x1871271580263296:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 53us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.712602:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00080000:1.0:1784584097.713599:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784584097.713605:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584097.720460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.720880:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263552 00000100:00100000:2.0:1784584097.720890:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263552 00000100:00100000:2.0:1784584097.720950:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584097.720960:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580263552:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784584097.721049:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580263552:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 90us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.721068:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584097.727800:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.727838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584097.728007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.728146:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263680 00000100:00100000:0.0:1784584097.728157:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263680 00000100:00100000:0.0:1784584097.728204:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263808 00000100:00100000:0.0:1784584097.728216:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263808 00000100:00100000:0.0:1784584097.728359:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1784584097.728367:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1871271580263680:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784584097.728413:0:18694:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec83902b-e7e6-476f-9537-00c010e7ce56@192.168.203.51@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1784584097.728449:0:18694:0:(genops.c:1406:class_connect()) connect: client ec83902b-e7e6-476f-9537-00c010e7ce56, cookie 0xdab2421a42e48f94 00002000:00100000:0.0:1784584097.728461:0:18694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec83902b-e7e6-476f-9537-00c010e7ce56/ffff98b43eb07000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784584097.729377:0:18694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784584097.729511:0:18694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784584097.729576:0:18694:0:(import.c:65:import_set_state_nolock()) ffff98b43c23b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584097.729858:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584097.729867:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1871271580263808:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784584097.729894:0:18692:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ec83902b-e7e6-476f-9537-00c010e7ce56@192.168.203.51@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1784584097.729919:0:18692:0:(genops.c:1406:class_connect()) connect: client ec83902b-e7e6-476f-9537-00c010e7ce56, cookie 0xdab2421a42e48f9b 00002000:00100000:2.0:1784584097.729930:0:18692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec83902b-e7e6-476f-9537-00c010e7ce56/ffff98b3049d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784584097.729937:0:18692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784584097.729983:0:18692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784584097.730000:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b3049d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584097.730028:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580263936 00000100:00100000:1.0:1784584097.730036:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580263936 00000100:00100000:1.0:1784584097.730088:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1784584097.730097:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580263936:12345-192.168.203.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784584097.730216:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2397:x1871271580263680:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 1838us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.730225:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1784584097.731383:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580263936:12345-192.168.203.51@tcp:900:mount.lustre.0 Request processed in 1279us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584097.731395:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1784584097.731497:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2397:x1871271580263808:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 1627us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.731506:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:1.0:1784584097.739093:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584097.739190:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264064 00000100:00100000:0.0:1784584097.739201:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264064 00000100:00100000:0.0:1784584097.739327:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784584097.739338:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580264064:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784584097.739440:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784584097.739556:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15049:x1871271580264064:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 219us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.739565:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784584097.965822:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584097.965846:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599207296:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.965917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.965997:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599207424:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.966057:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207424 00000100:00100000:0.0:1784584097.966064:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207424 00000100:00100000:0.0:1784584097.966243:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784584097.966267:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599207424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966323:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599207424:12345-0@lo:400:kworker.0 Request processed in 58us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.966331:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784584097.966368:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599207424:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966415:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584097.966422:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599207808:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.966741:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599207936:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.966836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584097.966845:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599208320:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.966872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584097.966877:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584097.966924:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584097.966928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584097.967011:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207808 00000100:00100000:1.0:1784584097.967018:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207808 00000100:00100000:1.0:1784584097.967053:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208320 00000100:00100000:1.0:1784584097.967057:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208320 00000100:00100000:1.0:1784584097.967079:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584097.967087:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599207808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584097.967418:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207936 00000100:00100000:2.0:1784584097.967423:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207936 00000100:00100000:2.0:1784584097.967452:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584097.967460:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599207936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.969783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.970075:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584097.970085:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599208832:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.970128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.970172:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599208960:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.970196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.970256:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207168 00000100:00100000:0.0:1784584097.970262:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207168 00000100:00100000:0.0:1784584097.970310:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208448 00000100:00100000:0.0:1784584097.970312:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208448 00000100:00100000:0.0:1784584097.970324:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584097.970329:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599207168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584097.970357:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784584097.970389:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599207168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (3465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.970393:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584097.970404:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584097.970408:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599208448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584097.970415:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784584097.970444:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599208448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.970450:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1784584097.970464:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584097.970496:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584097.970528:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584097.970567:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208832 00000100:00100000:0.0:1784584097.970570:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208832 00000100:00100000:0.0:1784584097.970769:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208960 00000100:00100000:0.0:1784584097.970773:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208960 00000100:00100000:0.0:1784584097.970791:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584097.970798:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599208320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.970951:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599208320:12345-0@lo:400:kworker.0 Request processed in 152us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.970959:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584097.970975:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584097.970982:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971014:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599208832:12345-0@lo:400:kworker.0 Request processed in 33us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.971031:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584097.971044:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784584097.971049:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599208960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971079:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599208960:12345-0@lo:400:kworker.0 Request processed in 30us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.971085:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1784584097.971100:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784584097.971103:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784584097.971121:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304998000 x1871271599208960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584097.971133:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599208960:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971144:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599208832:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971153:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599208320:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971218:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599207040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784584097.971264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.971288:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599207680:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.971342:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599208192:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.971386:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599208704:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.971433:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584097.971440:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599208576:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.971521:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207680 00000100:00100000:0.0:1784584097.971525:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207680 00000100:00100000:0.0:1784584097.971544:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208192 00000100:00100000:0.0:1784584097.971546:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208192 00000100:00100000:0.0:1784584097.971571:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584097.971575:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599207680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971740:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599207680:12345-0@lo:400:kworker.0 Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.971746:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584097.971758:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584097.971764:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599208192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.971790:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599208192:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.971796:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784584097.971813:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584097.971842:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599207680:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972030:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599208192:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972054:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207040 00000100:00100000:0.0:1784584097.972058:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207040 00000100:00100000:0.0:1784584097.972078:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584097.972083:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599207040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784584097.972096:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784584097.972130:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871271599207040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.972136:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584097.972175:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599207040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784584097.972194:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208704 00000100:00100000:0.0:1784584097.972198:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208704 00000100:00100000:0.0:1784584097.972233:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208576 00000100:00100000:0.0:1784584097.972237:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208576 00000100:00100000:0.0:1784584097.972251:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584097.972257:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599208704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972290:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599208704:12345-0@lo:400:kworker.0 Request processed in 33us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.972296:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584097.972307:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584097.972313:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599208576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972337:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599208576:12345-0@lo:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.972344:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1784584097.972357:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784584097.972365:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784584097.972382:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599208576:0@lo:400:kworker.0 00010000:00080000:0.0:1784584097.972393:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b304998700 x1871271599208704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584097.972401:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599208704:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972427:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207296 00000100:00100000:0.0:1784584097.972430:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207296 00000100:00100000:0.0:1784584097.972455:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784584097.972461:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599207296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.972515:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599207296:12345-0@lo:400:kworker.0 Request processed in 54us (6599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.972529:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784584097.972658:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599207296:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.973541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584097.973765:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599207808:12345-0@lo:400:kworker.0 Request processed in 6677us (7314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584097.973776:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584097.973808:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264192 00000100:00100000:0.0:1784584097.973815:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264192 00000100:00100000:1.0:1784584097.973818:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599207808:0@lo:400:kworker.0 00000100:00100000:1.0:1784584097.973848:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:1.0:1784584097.973858:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15087:x1871271580264192:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:1.0:1784584097.973878:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584097.973896:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e48fa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee741 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.973961:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.973975:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.974003:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584097.974047:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584097.974051:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584097.974070:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.974110:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e48fa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.974129:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584097.974136:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:1.0:1784584097.974139:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584097.974142:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c200, rc 0) 00000100:00100000:1.0:1784584097.974188:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+7:15087:x1871271580264192:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 333us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584097.974195:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:1.0:1784584097.979760:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599207936:0@lo:400:kworker.0 00000100:00100000:3.0:1784584097.980653:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584097.980670:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599207552:0@lo:400:kworker.0 00000100:00100000:2.0:1784584097.980688:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599207936:12345-0@lo:400:kworker.0 Request processed in 12258us (12948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584097.980700:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784584097.980792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584097.980832:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599208064:0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.980847:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599207552 00000100:00100000:0.0:1784584097.980855:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599207552 00000100:00100000:3.0:1784584097.980891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584097.981317:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599208064 00000100:00100000:0.0:1784584097.981322:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599208064 00000100:00080000:3.0:1784584097.981426:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584097.983557:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584097.983581:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599207552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584097.983668:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599207552:12345-0@lo:400:kworker.0 Request processed in 99us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584097.983677:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584097.983911:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584097.983924:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599208064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584097.983967:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599208064:12345-0@lo:400:kworker.0 Request processed in 47us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584097.983974:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584097.984417:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599207552:0@lo:400:kworker.0 00000100:00100000:3.0:1784584097.984432:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599208064:0@lo:400:kworker.0 00010000:00010000:1.0:1784584098.413637:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784584098.999305:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:0.0:1784584098.999321:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000001:00080000:0.0:1784584098.999329:0:19508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1784584099.440904:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584099.889275:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1784584100.015295:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:1.0:1784584100.015309:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00010000:00010000:3.0:1784584100.469309:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584100.515965:0:20065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1784584100.525867:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599209088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784584100.525943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584100.526097:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209088 00000100:00100000:1.0:1784584100.526105:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209088 00000100:00100000:1.0:1784584100.526165:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584100.526174:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599209088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784584100.526225:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1784584100.526227:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584100.526292:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599209088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584100.526300:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584100.526341:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599209088:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1784584100.528354:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:0.0:1784584100.528366:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000001:00100000:1.0:1784584100.529821:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:1.0:1784584100.529843:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00010000:00010000:3.0:1784584101.489599:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584101.550241:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599209216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584101.550310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584101.550396:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209216 00000100:00100000:2.0:1784584101.550404:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209216 00000100:00100000:2.0:1784584101.550455:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584101.550464:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599209216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584101.550521:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584101.550765:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599209344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584101.550795:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584101.550872:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209344 00000100:00100000:3.0:1784584101.550877:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209344 00000100:00100000:3.0:1784584101.550912:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584101.550920:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599209344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584101.550939:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784584101.551085:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599209344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584101.551092:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784584101.551328:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599209216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 864us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584101.551336:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584101.551627:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b3048a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599209344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584101.551844:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599209216:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784584102.448368:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784584102.509712:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584103.001381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.001426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.001457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.001511:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584103.001613:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264704 00000100:00100000:1.0:1784584103.001622:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264704 00000100:00100000:1.0:1784584103.001683:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265216 00000100:00100000:1.0:1784584103.001686:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265216 00000100:00100000:1.0:1784584103.001709:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584103.001717:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264704:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.001787:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264704:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.001795:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584103.001810:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584103.001816:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265216:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.001838:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265216:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 22us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.001844:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00080000:1.0:1784584103.001860:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584103.002290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.002322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.002341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.002356:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.002373:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584103.002391:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264448 00000100:00100000:3.0:1784584103.002395:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264448 00000100:00100000:3.0:1784584103.002422:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264960 00000100:00100000:3.0:1784584103.002425:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264960 00000100:00100000:3.0:1784584103.002443:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264576 00000100:00100000:3.0:1784584103.002445:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264576 00000100:00100000:3.0:1784584103.002454:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265088 00000100:00100000:3.0:1784584103.002455:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265088 00000100:00100000:3.0:1784584103.002635:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1784584103.002643:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2399:x1871271580264448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.002734:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264320 00000100:00100000:1.0:1784584103.002738:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264320 00000100:00100000:1.0:1784584103.002767:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:1.0:1784584103.002773:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2399:x1871271580264320:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.002811:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2399:x1871271580264320:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.002819:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:1.0:1784584103.002849:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:1.0:1784584103.002856:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2399:x1871271580264960:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.002880:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2399:x1871271580264960:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.002886:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:1.0:1784584103.002898:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1784584103.002903:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.002925:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 21us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.002930:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1784584103.002940:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1784584103.002945:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265088:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584103.002962:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265088:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 17us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.002967:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784584103.003195:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2399:x1871271580264448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 552us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584103.003202:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1784584103.003223:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580264832 00000100:00100000:3.0:1784584103.003227:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580264832 00000100:00100000:3.0:1784584103.003256:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265344 00000100:00100000:3.0:1784584103.003259:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265344 00000100:00100000:3.0:1784584103.003272:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584103.003277:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b3048a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264832:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584103.003299:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b3048a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580264832:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 21us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584103.003304:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584103.003313:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:3.0:1784584103.003318:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584103.003337:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580265344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 19us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584103.003342:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00080000:3.0:1784584103.003362:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584103.003367:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584103.003369:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584103.085706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584103.085729:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599209472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584103.085802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086002:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599209984:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086105:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599210496:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086151:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599211008:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086193:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086219:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784584103.086225:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599209856:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086281:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599210368:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086323:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599210880:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086364:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599211392:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.086388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584103.086421:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209984 00000100:00100000:3.0:1784584103.086428:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209984 00000100:00100000:3.0:1784584103.086491:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210496 00000100:00100000:3.0:1784584103.086494:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210496 00000100:00100000:3.0:1784584103.086511:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584103.086623:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599209600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584103.086654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086672:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599210112:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599210624:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086750:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599211136:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086782:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1784584103.086787:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599209728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584103.086806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086816:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599210240:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086864:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599210752:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086895:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599211264:0@lo:400:kworker.0 00000100:00100000:2.0:1784584103.086915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.086935:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209472 00000100:00100000:2.0:1784584103.086939:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209472 00000100:00100000:2.0:1784584103.086970:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209600 00000100:00100000:2.0:1784584103.086973:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209600 00000100:00100000:2.0:1784584103.086987:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209728 00000100:00100000:2.0:1784584103.086990:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209728 00000100:00100000:2.0:1784584103.087004:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584103.087011:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599209472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584103.087039:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584103.087080:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599209472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.087086:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584103.087101:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584103.087107:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599209600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584103.087120:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784584103.087156:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599209600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.087162:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584103.087182:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584103.087189:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599209728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584103.087197:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784584103.087229:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599209728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.087235:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584103.087275:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43ef1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599209472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584103.087302:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1784584103.087315:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599209728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584103.087328:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599209600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584103.087372:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211008 00000100:00100000:2.0:1784584103.087375:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211008 00000100:00100000:2.0:1784584103.087397:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210368 00000100:00100000:2.0:1784584103.087399:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210368 00000100:00100000:2.0:1784584103.087410:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210880 00000100:00100000:2.0:1784584103.087412:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210880 00000100:00100000:2.0:1784584103.087421:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211392 00000100:00100000:2.0:1784584103.087423:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211392 00000100:00100000:2.0:1784584103.087435:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211136 00000100:00100000:2.0:1784584103.087438:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211136 00000100:00100000:2.0:1784584103.087448:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211264 00000100:00100000:2.0:1784584103.087451:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211264 00000100:00100000:2.0:1784584103.087463:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584103.087493:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599211008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.087626:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584103.087636:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599210496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584103.087754:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210112 00000100:00100000:0.0:1784584103.087765:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210112 00000100:00100000:0.0:1784584103.087784:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210624 00000100:00100000:0.0:1784584103.087787:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210624 00000100:00100000:0.0:1784584103.087799:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210240 00000100:00100000:0.0:1784584103.087802:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210240 00000100:00100000:0.0:1784584103.087811:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599210752 00000100:00100000:0.0:1784584103.087813:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599210752 00000100:00100000:0.0:1784584103.087823:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584103.087829:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599210112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584103.087872:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599210112:12345-0@lo:400:kworker.0 Request processed in 43us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584103.087879:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584103.087892:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584103.087898:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599210624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584103.087926:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599210624:12345-0@lo:400:kworker.0 Request processed in 28us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584103.087931:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584103.087942:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584103.087948:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599210240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584103.087973:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599210240:12345-0@lo:400:kworker.0 Request processed in 26us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584103.087979:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584103.087990:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584103.087996:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599210752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584103.088021:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599210752:12345-0@lo:400:kworker.0 Request processed in 25us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584103.088027:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584103.088400:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599211008:12345-0@lo:400:kworker.0 Request processed in 906us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.088408:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584103.088424:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584103.088431:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.088870:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599210496:12345-0@lo:400:kworker.0 Request processed in 1235us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.088880:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584103.088907:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599209856 00000100:00100000:1.0:1784584103.088913:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599209856 00000100:00100000:1.0:1784584103.088942:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784584103.088947:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.088978:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599209856:12345-0@lo:400:kworker.0 Request processed in 31us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.088984:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784584103.089011:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784584103.089018:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599210880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.089041:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599210880:12345-0@lo:400:kworker.0 Request processed in 25us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.089047:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784584103.089058:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584103.089064:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599211392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.089279:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599209984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.089296:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599211392:12345-0@lo:400:kworker.0 Request processed in 22us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.089306:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584103.089323:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584103.089333:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599211136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.089348:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599209984:12345-0@lo:400:kworker.0 Request processed in 2827us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584103.089356:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584103.089370:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599211136:12345-0@lo:400:kworker.0 Request processed in 40us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.089377:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1784584103.089393:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584103.089400:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584103.089405:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584103.089408:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784584103.089416:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599211264:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784584103.089417:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584103.089459:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599209856:0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.089773:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599211264:12345-0@lo:400:kworker.0 Request processed in 357us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.089780:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784584103.092690:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599210368:12345-0@lo:400:kworker.0 Request processed in 4250us (6376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.092778:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784584103.094797:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599210240:0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.094816:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599210752:0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.094832:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599211264:0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.094843:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599210112:0@lo:400:kworker.0 00000100:00100000:1.0:1784584103.094852:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599210624:0@lo:400:kworker.0 00010000:00080000:1.0:1784584103.095688:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4376cca80 x1871271599211136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584103.095706:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599211136:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.096196:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599210368:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.096216:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599210880:0@lo:400:kworker.0 00010000:00080000:3.0:1784584103.096240:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b4376cc380 x1871271599211392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584103.096249:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599211392:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.096260:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599209984:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.096270:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599210496:0@lo:400:kworker.0 00000100:00100000:3.0:1784584103.096280:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599211008:0@lo:400:kworker.0 00010000:00010000:3.0:1784584103.535330:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584103.537806:0:20212:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8a9b7a70 20000000:00000080:0.0:1784584103.537825:0:20212:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b43e93f800 uarg=0000000000000000 20000000:01000000:0.0:1784584103.537862:0:20212:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784584103.537868:0:20212:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784584103.537873:0:20212:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784584103.538301:0:20213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1784584103.538455:0:20212:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784584103.544601:0:20212:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784584103.544634:0:20212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544654:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544662:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544669:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544676:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544686:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544693:0:20212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544700:0:20212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544745:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544775:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 12 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.544789:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211520:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584103.544935:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544944:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.544952:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211648:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584103.544979:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.544992:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.545188:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211776:0@lo:104: 00000100:00100000:0.0:1784584103.545240:0:20212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784584103.545461:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.545501:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 23 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.545509:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211904:0@lo:104: 00000100:00100000:0.0:1784584103.545531:0:20212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784584103.545625:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.545633:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 23 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.545641:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599212032:0@lo:104: 00000100:00100000:0.0:1784584103.545661:0:20212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.545687:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211776 00000100:00100000:2.0:1784584103.545694:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211776 00000100:00100000:3.0:1784584103.545721:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599211904 00000100:00100000:3.0:1784584103.545726:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599211904 00000100:00100000:2.0:1784584103.545734:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584103.545741:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:20212:x1871271599211776:12345-0@lo:104: 00010000:00010000:2.0:1784584103.545753:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.545808:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584103.545813:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:20212:x1871271599211776:12345-0@lo:104: Request processed in 73us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.545820:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584103.545835:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584103.545840:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:20212:x1871271599211904:12345-0@lo:104: 00010000:00010000:2.0:1784584103.545847:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.545878:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784584103.545894:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:20212:x1871271599211904:12345-0@lo:104: Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.545900:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1784584103.545917:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584103.545922:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.545929:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584103.545939:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.545947:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584103.545954:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584103.545960:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584103.545987:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.545993:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584103.546022:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546028:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e48d25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48d2c expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546040:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584103.546043:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546048:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cfe00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584103.546050:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546465:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584103.546511:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584103.546518:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584103.546534:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546539:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584103.546556:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546563:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172cfe00/0xdab2421a42e48c8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c92 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546573:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.546575:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.546576:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584103.546598:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599212160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584103.546630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.546674:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599212288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584103.546695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.546727:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212160 00000100:00100000:2.0:1784584103.546731:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212160 00010000:00010000:2.0:1784584103.546750:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 24 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584103.546771:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212288 00000100:00100000:2.0:1784584103.546774:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212288 00010000:00010000:2.0:1784584103.546792:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 25 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584103.546805:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584103.546811:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+25:3642:x1871271599212160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584103.546821:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584103.546825:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 25 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546835:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 25 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546851:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584103.546877:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+25:3642:x1871271599212160:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.546884:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584103.546896:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584103.546903:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599212288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584103.546910:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584103.546914:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 24 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546923:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 24 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.546934:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584103.546958:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599212288:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.546964:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584103.547019:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599212288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584103.547044:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599212160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584103.547309:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584103.547605:0:20212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.547616:0:20212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 23 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.547626:0:20212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599212416:0@lo:104: 00000100:00100000:0.0:1784584103.547651:0:20212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584103.548805:0:20212:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302862600 going to sleep for 11 seconds 00010000:00010000:0.0:1784584103.548833:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cf800/0xdab2421a42e48d2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48d25 expref: 23 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.548845:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b304999c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211776:0@lo:104: 00010000:00010000:0.0:1784584103.548854:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97a00/0xdab2421a42e48c92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48c8b expref: 22 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.548862:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211904:0@lo:104: 00000100:00100000:3.0:1784584103.548961:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212032 00000100:00100000:3.0:1784584103.548968:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212032 00000100:00100000:2.0:1784584103.549106:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212416 00000100:00100000:2.0:1784584103.549110:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212416 00000100:00100000:2.0:1784584103.549211:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584103.549219:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:20212:x1871271599212416:12345-0@lo:104: 00010000:00010000:2.0:1784584103.549398:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549562:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584103.549569:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+4:20212:x1871271599212416:12345-0@lo:104: Request processed in 351us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.549577:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1784584103.549598:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584103.549603:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549615:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584103.549619:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549627:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584103.549634:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584103.549639:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584103.549688:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549694:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584103.549714:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549721:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce200/0xdab2421a42e48c3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c45 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549731:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.549733:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.549734:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584103.549745:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599212544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584103.549777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.549814:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212544 00000100:00100000:2.0:1784584103.549818:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212544 00010000:00010000:2.0:1784584103.549835:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 22 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584103.549853:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584103.549858:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584103.549860:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3640:x1871271599212544:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584103.549864:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:20212:x1871271599212032:12345-0@lo:104: 00010000:00010000:3.0:1784584103.549871:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549894:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584103.549900:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 22 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.549909:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 22 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584103.549925:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1784584103.549925:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584103.549929:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+3:20212:x1871271599212032:12345-0@lo:104: Request processed in 66us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584103.549935:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584103.549953:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3640:x1871271599212544:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.549959:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584103.549986:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3640:1871271599212544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584103.550005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:2.0:1784584103.550026:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584103.550030:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550036:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584103.550039:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550046:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584103.550051:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584103.550066:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584103.550081:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550086:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584103.550100:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550106:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96e00/0xdab2421a42e48c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e48c53 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550391:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.550399:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584103.550400:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584103.550412:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599212672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584103.550437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584103.550497:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265472 00000100:00100000:2.0:1784584103.550500:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265472 00010000:00010000:2.0:1784584103.550517:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 13 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584103.550531:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212672 00000100:00100000:2.0:1784584103.550534:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212672 00010000:00010000:2.0:1784584103.550542:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 22 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584103.550552:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784584103.550557:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2400:x1871271580265472:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584103.550564:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584103.550568:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 13 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550577:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 13 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550588:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584103.550623:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2400:x1871271580265472:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 66us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.550629:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784584103.550640:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584103.550645:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3641:x1871271599212672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584103.550658:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584103.550662:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 22 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550669:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 22 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584103.550678:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584103.550703:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3641:x1871271599212672:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584103.550708:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584103.550742:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599212672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584103.551041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:0.0:1784584103.551389:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ebd8400/0xdab2421a42e48c45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48c3e expref: 21 pid: 17179 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.551400:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43769aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599212416:0@lo:104: 00010000:00010000:0.0:1784584103.551411:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b8800/0xdab2421a42e48f7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee710 expref: 12 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.551427:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211520:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784584103.551440:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30499ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599211648:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584103.551449:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96400/0xdab2421a42e48c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e48c4c expref: 20 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584103.551456:0:20212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20212:1871271599212032:0@lo:104: 00010000:00010000:0.0:1784584103.551499:0:20212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584103.551873:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265600 00000100:00100000:1.0:1784584103.551951:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265600 00010000:00010000:1.0:1784584103.551979:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584103.554418:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1784584103.554441:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:2400:x1871271580265600:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584103.554460:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584103.554491:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554535:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554554:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983000/0xdab2421a42e48f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6a0 expref: 12 pid: 17180 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554569:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554578:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554596:0:17171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554603:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554615:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554621:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554627:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584103.554631:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554638:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554666:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584103.554677:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584103.554730:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:2400:x1871271580265600:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 300us (3689us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584103.554738:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00010000:00010000:0.0:1784584103.554862:0:20212:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.554871:0:20212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584103.554877:0:20212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e48fb0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584104.559440:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584104.877541:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584104.877549:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b303408000 from 13 10000000:01000000:1.0:1784584104.877554:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584104.877602:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.877614:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.877626:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.877650:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599212800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.877714:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.877762:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.877825:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212800 00000100:00100000:0.0:1784584104.877833:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212800 00000100:00100000:0.0:1784584104.877885:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784584104.877895:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:17184:x1871271599212800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584104.877908:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584104.877921:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8600/0xdab2421a42e48fbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48fb7 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.877944:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8600/0xdab2421a42e48fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48fb7 expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.877968:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8600/0xdab2421a42e48fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48fb7 expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.877976:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8600, rc 0) 00000100:00100000:0.0:1784584104.878031:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599212800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.878038:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784584104.878134:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599212800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584104.878149:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584104.878158:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584104.878241:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599212928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584104.878268:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584104.878292:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40890fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.878402:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599212928 00000100:00100000:0.0:1784584104.878406:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599212928 00000100:00100000:0.0:1784584104.878445:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784584104.878453:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599212928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584104.878584:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599212928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.878590:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784584104.878706:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599212928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584104.878737:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584104.878776:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584104.878823:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584104.878906:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213056 00000100:00100000:1.0:1784584104.878910:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213056 00000100:00100000:1.0:1784584104.878936:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784584104.878943:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599213056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.879032:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599213056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584104.879048:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784584104.879224:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784584104.880298:0:20280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784584104.880572:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784584104.880596:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584104.880605:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.880616:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584104.880626:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584104.880628:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b405f4d000 from 13 10000000:01000000:1.0:1784584104.880631:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584104.880665:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.880672:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.880681:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.880701:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.880748:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.880776:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.880830:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213184 00000100:00100000:0.0:1784584104.880836:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213184 00000100:00100000:0.0:1784584104.880878:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784584104.880886:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:17184:x1871271599213184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584104.880896:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584104.880908:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9c00/0xdab2421a42e48fcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48fc5 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.880928:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9c00/0xdab2421a42e48fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48fc5 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.880937:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9c00/0xdab2421a42e48fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48fc5 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.880961:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9c00, rc 0) 00000100:00100000:0.0:1784584104.881002:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.881009:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784584104.881127:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584104.881141:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.881149:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.881219:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.881245:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.881267:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.881349:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213312 00000100:00100000:0.0:1784584104.881354:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213312 00000100:00100000:0.0:1784584104.881385:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784584104.881392:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584104.881519:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.881526:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784584104.881595:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584104.881623:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584104.881660:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584104.881699:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584104.881767:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213440 00000100:00100000:1.0:1784584104.881770:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213440 00000100:00100000:1.0:1784584104.881789:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784584104.881794:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.881866:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584104.881872:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784584104.881940:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584104.882821:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784584104.883002:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784584104.883037:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584104.883046:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.883056:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584104.883065:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584104.883067:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b437661000 from 13 10000000:01000000:1.0:1784584104.883070:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584104.883096:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.883104:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.883114:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.883140:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.883193:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.883234:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584104.883400:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213568 00000100:00100000:2.0:1784584104.883406:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213568 00000100:00100000:2.0:1784584104.883449:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784584104.883458:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:17184:x1871271599213568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584104.883501:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584104.883515:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b3041c1a00/0xdab2421a42e48fda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48fd3 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584104.883534:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b3041c1a00/0xdab2421a42e48fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48fd3 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584104.883543:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b3041c1a00/0xdab2421a42e48fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48fd3 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584104.883552:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1a00, rc 0) 00000100:00100000:2.0:1784584104.883590:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584104.883597:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784584104.883910:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584104.883924:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.883934:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.883988:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.884017:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.884072:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584104.896990:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213696 00000100:00100000:2.0:1784584104.897109:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213696 00000100:00100000:2.0:1784584104.897206:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784584104.897216:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584104.897400:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42e8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (13382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584104.897408:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784584104.897560:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.897612:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.897663:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.897696:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584104.897801:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213824 00000100:00100000:2.0:1784584104.897806:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213824 00000100:00100000:2.0:1784584104.897841:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784584104.897848:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584104.898129:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584104.898146:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784584104.901566:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784584104.904137:0:20282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784584104.904390:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784584104.904421:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584104.904433:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.904445:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584104.904502:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584104.904505:0:17184:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b3041fd000 from 13 10000000:01000000:1.0:1784584104.904508:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584104.904550:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.904558:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584104.904568:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584104.904593:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.904658:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584104.904694:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.904850:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599213952 00000100:00100000:0.0:1784584104.904857:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599213952 00000100:00100000:0.0:1784584104.904903:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784584104.904913:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:17184:x1871271599213952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584104.904925:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584104.904937:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e48fe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e48fe1 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.904960:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e48fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e48fe1 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.905150:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e48fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e48fe1 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.905183:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8a00, rc 0) 00000100:00100000:0.0:1784584104.905230:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599213952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.905237:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784584104.905280:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599213952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584104.905298:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.905370:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584104.905428:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599214080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584104.905453:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584104.905534:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584104.911071:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599214080 00000100:00100000:1.0:1784584104.911087:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599214080 00000100:00100000:1.0:1784584104.911158:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784584104.911191:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599214080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584104.911374:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599214080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (5919us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584104.911382:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784584104.913654:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599214080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584104.913712:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599214208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584104.913801:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584104.913847:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584104.913895:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599214208 00000100:00100000:0.0:1784584104.913901:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599214208 00000100:00100000:0.0:1784584104.913953:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784584104.913962:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599214208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584104.914058:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:17184:x1871271599214208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584104.914066:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784584104.914221:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:17184:1871271599214208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784584104.915019:0:20283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784584104.915230:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784584104.915250:0:17184:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784584104.915259:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584104.915283:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584105.112351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584105.114189:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265728 00000100:00100000:0.0:1784584105.114204:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265728 00000100:00100000:0.0:1784584105.114285:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:0.0:1784584105.114296:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:14935:x1871271580265728:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584105.114313:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584105.114330:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9800/0xdab2421a42e48fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee748 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584105.114357:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9800/0xdab2421a42e48fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee748 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584105.114369:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9800/0xdab2421a42e48fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee748 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584105.114378:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9800, rc 0) 00000100:00100000:0.0:1784584105.114448:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580265728:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 154us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584105.114456:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:3.0:1784584105.116238:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584105.116368:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265856 00000100:00100000:1.0:1784584105.116376:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265856 00000100:00100000:1.0:1784584105.116426:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:1.0:1784584105.116436:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580265856:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584105.116603:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580265856:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 168us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584105.116619:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:1.0:1784584105.127657:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584105.128341:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580265984 00000100:00100000:2.0:1784584105.128353:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580265984 00000100:00100000:2.0:1784584105.128414:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:2.0:1784584105.128424:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580265984:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584105.128726:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580265984:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 302us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584105.128735:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:0.0:1784584105.145058:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584105.145594:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266112 00000100:00100000:1.0:1784584105.145605:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266112 00000100:00100000:1.0:1784584105.145720:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:1.0:1784584105.145730:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:14935:x1871271580266112:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584105.145749:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584105.145768:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c600/0xdab2421a42e48ff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee74f expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584105.145797:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c600/0xdab2421a42e48ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee74f expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584105.145808:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c600/0xdab2421a42e48ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee74f expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584105.145817:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c600, rc 0) 00000100:00100000:1.0:1784584105.145868:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:14935:x1871271580266112:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 140us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584105.145875:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:0.0:1784584105.152858:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584105.152922:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266240 00000100:00100000:1.0:1784584105.152932:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266240 00000100:00100000:1.0:1784584105.152989:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:1.0:1784584105.152998:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:14935:x1871271580266240:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584105.153135:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:14935:x1871271580266240:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584105.153153:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:1.0:1784584105.157425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584105.157640:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266368 00000100:00100000:3.0:1784584105.157651:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266368 00000100:00100000:3.0:1784584105.157721:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:3.0:1784584105.157732:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:14935:x1871271580266368:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584105.157872:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:14935:x1871271580266368:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 142us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584105.157880:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 163 00010000:00010000:2.0:1784584105.582038:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584105.645913:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584105.645940:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599214336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584105.646025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584105.646202:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599214336 00000100:00100000:2.0:1784584105.646210:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599214336 00000100:00100000:2.0:1784584105.646285:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584105.646295:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599214336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784584105.646322:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1784584105.646495:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584105.646834:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599214336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 539us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584105.646842:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584105.646962:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599214336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784584106.606141:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584106.639640:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.639719:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266496 00000100:00100000:1.0:1784584106.639728:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266496 00000100:00100000:1.0:1784584106.639797:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1784584106.639809:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:15603:x1871271580266496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584106.639829:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.639849:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e48ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee756 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639911:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639926:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639950:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639964:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639972:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.639978:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640059:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640079:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640085:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584106.640117:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584106.640121:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584106.640167:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640177:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640184:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640190:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640196:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1dc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.640200:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640208:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640219:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:1.0:1784584106.640222:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.640226:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640242:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640256:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640262:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640267:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640272:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.640275:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640281:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640289:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98b3037b7d00) 00010000:00010000:1.0:1784584106.640292:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.640295:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640300:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e4900b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640331:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e48ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee756 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640358:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee756 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.640365:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b3037b7100) 00010000:00010000:1.0:1784584106.640367:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584106.640370:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c800, rc 0) 00000100:00100000:1.0:1784584106.640439:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15603:x1871271580266496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 633us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.640446:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00080000:3.0:1784584106.640850:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584106.645685:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.646374:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266624 00000100:00100000:1.0:1784584106.646385:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266624 00000100:00100000:1.0:1784584106.646449:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1784584106.646459:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15603:x1871271580266624:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784584106.646563:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15603:x1871271580266624:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 Request processed in 105us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.646580:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1784584106.655171:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.655325:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580266880 00000100:00100000:1.0:1784584106.655335:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580266880 00000100:00100000:1.0:1784584106.655399:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1784584106.655409:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:15603:x1871271580266880:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584106.655430:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.655449:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49019 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee75d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655553:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655579:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655590:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655606:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655613:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.655620:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.655813:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9a00/0xdab2421a42e4902e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.655831:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9a00/0xdab2421a42e4902e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.655840:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9a00/0xdab2421a42e4902e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584106.655851:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784584106.655994:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656003:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656010:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656016:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584106.656021:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656028:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656408:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b3037b7100) 00010000:00010000:0.0:1784584106.656462:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584106.656489:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656497:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d400/0xdab2421a42e49020 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656512:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656525:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656531:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656537:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1dc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584106.656540:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656547:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656556:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98b3037b7d00) 00010000:00010000:0.0:1784584106.656558:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584106.656561:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.656566:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1dc00/0xdab2421a42e49027 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.657456:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49019 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee75d expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.659005:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9a00/0xdab2421a42e4902e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee75d expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.659018:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b303986600) 00010000:00010000:0.0:1784584106.659021:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584106.659037:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9a00, rc 0) 00000100:00100000:0.0:1784584106.659113:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15603:x1871271580266880:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 3704us (3959us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784584106.659122:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784584106.663340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.663449:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267008 00000100:00100000:1.0:1784584106.663459:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267008 00000100:00100000:1.0:1784584106.663536:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784584106.663546:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15603:x1871271580267008:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784584106.663673:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15603:x1871271580267008:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.663688:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1784584106.668148:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584106.668317:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267136 00000100:00100000:2.0:1784584106.668328:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267136 00000100:00100000:2.0:1784584106.668395:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1784584106.668405:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15603:x1871271580267136:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1784584106.668815:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584106.672223:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599214592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584106.672293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584106.672335:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584106.672342:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599214464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584106.672364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584106.672399:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599214592 00000100:00100000:2.0:1784584106.672406:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599214592 00000100:00100000:2.0:1784584106.672453:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599214464 00000100:00100000:2.0:1784584106.672456:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599214464 00000100:00100000:2.0:1784584106.672489:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784584106.672649:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584106.672667:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599214464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784584106.672700:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784584106.672747:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599214464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.672753:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1784584106.672813:0:17188:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4355us 00000100:00100000:2.0:1784584106.673310:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599214592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584106.673333:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584106.673366:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599214592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 870us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584106.673374:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784584106.673462:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599214464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584106.673731:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599214592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584106.681917:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15603:x1871271580267136:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 13503us (13767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.681932:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1784584106.700464:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.700980:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267264 00000100:00100000:1.0:1784584106.700990:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267264 00000100:00100000:1.0:1784584106.701048:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1784584106.701058:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15609:x1871271580267264:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784584106.701078:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.701105:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e4903c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee764 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701181:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701195:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701206:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701221:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701227:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701233:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701287:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701295:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701302:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701308:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.701311:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701319:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701331:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:1.0:1784584106.701335:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.701340:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701346:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701359:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701365:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701370:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701381:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.701385:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701391:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701400:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b3037b7700) 00010000:00010000:1.0:1784584106.701403:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.701406:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701412:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4904a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701444:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e4903c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee764 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701453:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:1.0:1784584106.701456:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.701460:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e4903c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee764 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.701995:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1ca00, rc 0) 00000100:00100000:1.0:1784584106.702096:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15609:x1871271580267264:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1038us (1641us total) trans 0 rc 301/301 00000100:00100000:1.0:1784584106.702104:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1784584106.714880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584106.716126:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267392 00000100:00100000:0.0:1784584106.716139:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267392 00000100:00100000:0.0:1784584106.716214:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584106.716353:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15609:x1871271580267392:12345-192.168.203.51@tcp:700:lfs.0 00000100:00100000:0.0:1784584106.716445:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15609:x1871271580267392:12345-192.168.203.51@tcp:700:lfs.0 Request processed in 221us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584106.716453:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1784584106.722921:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584106.723020:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267648 00000100:00100000:0.0:1784584106.723030:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267648 00000100:00100000:0.0:1784584106.723144:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:0.0:1784584106.723166:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:15609:x1871271580267648:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:0.0:1784584106.723219:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584106.723255:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e48f6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d1 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.723272:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:0.0:1784584106.723278:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584106.723336:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.723350:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 5 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.723359:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.723406:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 5 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.723427:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 5 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584106.723442:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599214720:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784584106.723577:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164900 going to sleep for 11 seconds 00000100:00100000:0.0:1784584106.726542:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437699c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599214720:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584106.726569:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584106.726700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584106.726764:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267776 00000100:00100000:0.0:1784584106.726771:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267776 00010000:00010000:0.0:1784584106.726820:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 6 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584106.726847:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1784584106.726856:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2400:x1871271580267776:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584106.726869:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584106.726876:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 6 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726887:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 6 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726923:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e48fa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee741 expref: 6 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726939:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:0.0:1784584106.726943:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726952:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726959:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.726989:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584106.727035:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2400:x1871271580267776:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 179us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584106.727042:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00080000:3.0:1784584106.727104:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584106.727693:0:17187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.727709:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.727733:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.727741:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.727750:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729798:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729820:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729831:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584106.729849:0:17187:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaf1e45b reply state 00000000c720b0b2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729860:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729867:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:2.0:1784584106.729870:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784584106.729873:0:17187:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784584106.729879:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784584106.729900:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729907:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729913:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729919:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584106.729925:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729932:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729944:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b3037b7800) 00010000:00010000:2.0:1784584106.729946:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584106.729950:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729955:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e49051 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584106.729973:0:17187:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaf1e45b reply state 00000000c720b0b2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729982:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.729988:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b403a0e400) 00010000:00010000:2.0:1784584106.729990:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784584106.729998:0:17187:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784584106.730091:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+10:15609:x1871271580267648:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 6925us (7174us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784584106.730100:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1784584106.811723:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584106.811793:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580267904 00000100:00100000:0.0:1784584106.811803:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580267904 00000100:00100000:0.0:1784584106.811922:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1784584106.811934:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+10:15617:x1871271580267904:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:0.0:1784584106.811958:0:18716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584106.811988:0:18716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee76b expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812051:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812080:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812091:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584106.812134:0:18716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784584106.812138:0:18716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584106.812184:0:18716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812219:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee76b expref: 12 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812247:0:18716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee76b expref: 11 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.812255:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:0.0:1784584106.812257:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584106.812260:0:18716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8000, rc 0) 00000100:00100000:0.0:1784584106.812320:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+11:15617:x1871271580267904:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 387us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584106.812327:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:3.0:1784584106.837174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.837270:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580268032 00000100:00100000:1.0:1784584106.837292:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580268032 00000100:00100000:1.0:1784584106.837406:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:1.0:1784584106.837416:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:15618:x1871271580268032:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784584106.837436:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.837455:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee772 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837542:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837556:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837568:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584106.837609:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584106.837612:0:17188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584106.837634:0:17188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837656:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee772 expref: 7 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837690:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee772 expref: 6 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.837699:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:1.0:1784584106.837702:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584106.837705:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:1.0:1784584106.837786:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15618:x1871271580268032:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 371us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.837793:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:3.0:1784584106.841304:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.841393:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580268160 00000100:00100000:1.0:1784584106.841402:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580268160 00000100:00100000:1.0:1784584106.841462:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:1.0:1784584106.841495:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:15618:x1871271580268160:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784584106.841523:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.841543:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee779 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841602:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841616:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841627:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841639:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841646:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841667:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841740:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841766:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841774:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584106.841812:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584106.841816:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584106.841835:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841846:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841853:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841858:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841864:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.841867:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841874:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841886:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:1.0:1784584106.841889:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.841899:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841916:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841931:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841937:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841943:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841948:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1de00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.841951:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841957:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841966:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b403a0e400) 00010000:00010000:1.0:1784584106.841969:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.841972:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.841977:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e49090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.842002:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e49082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee779 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.842029:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee779 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.842036:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:1.0:1784584106.842038:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584106.842041:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c000, rc 0) 00000100:00100000:1.0:1784584106.842323:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+7:15618:x1871271580268160:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 830us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.842332:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:3.0:1784584106.848295:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.848389:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580268288 00000100:00100000:1.0:1784584106.848399:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580268288 00000100:00100000:1.0:1784584106.848508:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584106.848520:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:15618:x1871271580268288:12345-192.168.203.51@tcp:900:lfs.0 00000100:00100000:1.0:1784584106.848608:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:15618:x1871271580268288:12345-192.168.203.51@tcp:900:lfs.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.848616:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:3.0:1784584106.848962:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784584106.858735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584106.858805:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580268544 00000100:00100000:2.0:1784584106.858815:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580268544 00000100:00100000:2.0:1784584106.859043:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:2.0:1784584106.859054:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+7:15618:x1871271580268544:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784584106.859074:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584106.859095:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4909e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee780 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584106.859204:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784584106.859303:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4909e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee780 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.859318:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:2.0:1784584106.859321:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584106.859326:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4909e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee780 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.859353:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1e00, rc 0) 00000100:00100000:2.0:1784584106.859415:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+8:15618:x1871271580268544:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 363us (688us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1784584106.859423:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1784584106.865227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584106.866216:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580268800 00000100:00100000:3.0:1784584106.866227:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580268800 00000100:00100000:3.0:1784584106.866288:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1784584106.866298:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+8:15618:x1871271580268800:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:3.0:1784584106.866352:0:18716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584106.866381:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49097 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee779 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584106.866402:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:3.0:1784584106.866407:0:18716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584106.866429:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584106.866442:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584106.866590:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584106.866863:0:18716:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbe28d69 reply state 00000000630ae1e7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584106.866876:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584106.866883:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:3.0:1784584106.866885:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1784584106.866888:0:18716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784584106.866895:0:18716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784584106.867847:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+9:15618:x1871271580268800:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 1543us (2624us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1784584106.867858:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1784584106.883203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.883311:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269056 00000100:00100000:1.0:1784584106.883321:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269056 00000100:00100000:1.0:1784584106.883383:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:1.0:1784584106.883394:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+9:15618:x1871271580269056:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784584106.883656:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+10:15618:x1871271580269056:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 263us (461us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784584106.883664:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1784584106.889277:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.890830:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269312 00000100:00100000:1.0:1784584106.890860:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269312 00000100:00100000:1.0:1784584106.890991:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:1.0:1784584106.891004:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+10:15618:x1871271580269312:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1784584106.891435:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584106.891462:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e490b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891564:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891578:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891588:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891599:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891607:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891613:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584106.891725:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784584106.891800:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891807:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891826:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891832:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1de00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.891837:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891844:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891855:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:1.0:1784584106.891859:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.891863:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891869:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e490ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891883:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891889:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891895:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891900:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584106.891903:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891919:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891928:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b403a0e400) 00010000:00010000:1.0:1784584106.891930:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584106.891933:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891938:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e490c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891972:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e490b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee787 expref: 12 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891982:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:1.0:1784584106.891985:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584106.891988:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d000/0xdab2421a42e490b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee787 expref: 12 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584106.891998:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d000, rc 0) 00000100:00100000:1.0:1784584106.892084:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+11:15618:x1871271580269312:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1082us (2815us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1784584106.892093:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1784584106.898930:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.899163:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269440 00000100:00100000:1.0:1784584106.899175:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269440 00000100:00100000:0.0:1784584106.902303:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:0.0:1784584106.902331:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+11:15618:x1871271580269440:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584106.902357:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584106.902378:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e490cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee78e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902538:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902552:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902562:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584106.902586:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784584106.902590:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584106.902611:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902634:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e490cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902659:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584106.902668:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:0.0:1784584106.902671:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584106.902674:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8200, rc 0) 00000100:00100000:0.0:1784584106.902746:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+12:15618:x1871271580269440:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 419us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584106.902764:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1784584106.910453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.910647:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269568 00000100:00100000:1.0:1784584106.910657:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269568 00000100:00100000:1.0:1784584106.910752:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784584106.910775:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+12:15618:x1871271580269568:12345-192.168.203.51@tcp:37:lfs.0 00000100:00100000:2.0:1784584106.922941:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+12:15618:x1871271580269568:12345-192.168.203.51@tcp:37:lfs.0 Request processed in 12157us (12486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584106.922973:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1784584106.926638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584106.926804:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269824 00000100:00100000:0.0:1784584106.926814:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269824 00000100:00100000:0.0:1784584106.926873:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784584106.926882:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e695850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+12:15618:x1871271580269824:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784584106.927300:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e695850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+13:15618:x1871271580269824:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 417us (669us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784584106.927308:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1784584106.985749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584106.985838:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580269952 00000100:00100000:2.0:1784584106.985847:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580269952 00000100:00100000:2.0:1784584106.985906:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1784584106.985916:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+11:15624:x1871271580269952:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784584106.985937:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584106.985957:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e490dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee795 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986034:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986048:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986060:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986071:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986158:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986166:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986240:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986267:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986274:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584106.986308:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784584106.986312:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784584106.986344:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986356:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986364:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986371:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986377:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584106.986381:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986389:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986401:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:2.0:1784584106.986404:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584106.986408:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986424:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e490e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986438:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986443:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986449:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986455:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584106.986458:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986763:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986772:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b403a0e400) 00010000:00010000:2.0:1784584106.986775:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584106.986779:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986785:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a200/0xdab2421a42e490eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986811:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e490dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee795 expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986837:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee795 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.986845:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:2.0:1784584106.986847:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784584106.986850:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a800, rc 0) 00000100:00100000:2.0:1784584106.986914:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+12:15624:x1871271580269952:12345-192.168.203.51@tcp:101:bash.0 Request processed in 999us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584106.986922:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1784584106.990240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584106.990384:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580270080 00000100:00100000:1.0:1784584106.990393:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580270080 00000100:00100000:1.0:1784584106.990451:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584106.990461:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15624:x1871271580270080:12345-192.168.203.51@tcp:900:bash.0 00000100:00100000:1.0:1784584106.990794:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15624:x1871271580270080:12345-192.168.203.51@tcp:900:bash.0 Request processed in 334us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584106.990803:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1784584106.995546:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584106.995754:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580270336 00000100:00100000:2.0:1784584106.995764:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580270336 00000100:00100000:2.0:1784584106.995817:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:2.0:1784584106.995826:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+12:15624:x1871271580270336:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1784584106.995845:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584106.995863:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b200/0xdab2421a42e490f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee79c expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.996272:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.996289:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.996298:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.996330:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584106.996358:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 12 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584106.996372:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f7a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599214848:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584106.996450:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584107.001251:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584107.001422:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580270464 00000100:00100000:3.0:1784584107.001431:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580270464 00010000:00010000:3.0:1784584107.001620:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 13 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584107.001790:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784584107.001803:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+13:2400:x1871271580270464:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584107.001819:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584107.001827:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 13 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.001841:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 13 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.001865:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:2.0:1784584107.001870:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.001880:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.001888:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.001906:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584107.002514:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+13:2400:x1871271580270464:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 711us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.002523:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00010000:00010000:0.0:1784584107.002640:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e490d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee78e expref: 12 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584107.002658:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f7a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599214848:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584107.002680:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.002689:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.002695:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.002727:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.002739:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.002760:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003417:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003428:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003436:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584107.003445:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584107.003520:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003527:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003534:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003541:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584107.003545:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003552:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003563:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:0.0:1784584107.003567:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584107.003579:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003586:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b600/0xdab2421a42e49100 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584107.003600:0:17186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032ca1496 reply state 00000000812e7907 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003612:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003617:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98b303986000) 00010000:00010000:0.0:1784584107.003620:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784584107.003622:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784584107.003655:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b200/0xdab2421a42e490f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003667:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.003674:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584107.003676:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1784584107.003678:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8e00, rc 0) 00000100:00100000:0.0:1784584107.004696:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30499bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+15:15624:x1871271580270336:12345-192.168.203.51@tcp:101:bash.0 Request processed in 8865us (9153us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784584107.004706:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:2.0:1784584107.017923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584107.018026:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580270592 00000100:00100000:1.0:1784584107.018035:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580270592 00000100:00100000:1.0:1784584107.018096:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:1.0:1784584107.018106:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+15:15624:x1871271580270592:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784584107.018129:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584107.018157:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e4911c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7a3 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018222:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018246:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018258:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584107.018311:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784584107.018316:0:17188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584107.018338:0:17188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018362:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018388:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1de00/0xdab2421a42e4911c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 17 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018406:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 16 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.018595:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:1.0:1784584107.018598:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584107.018602:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1ca00, rc 0) 00000100:00100000:1.0:1784584107.018654:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:15624:x1871271580270592:12345-192.168.203.51@tcp:101:bash.0 Request processed in 549us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584107.018661:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1784584107.026008:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584107.026179:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580270848 00000100:00100000:1.0:1784584107.026188:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580270848 00000100:00100000:1.0:1784584107.026352:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1784584107.026363:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b304999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:15624:x1871271580270848:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:1.0:1784584107.026884:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b304999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+17:15624:x1871271580270848:12345-192.168.203.51@tcp:35:bash.0 Request processed in 514us (875us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1784584107.026893:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000040:00080000:3.0:1784584107.054658:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784584107.112589:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584107.112674:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580271104 00000100:00100000:3.0:1784584107.112684:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580271104 00000100:00100000:3.0:1784584107.112741:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1784584107.112762:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+17:15634:x1871271580271104:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784584107.112785:0:18716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584107.112805:0:18716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4912a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7aa expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584107.112897:0:18716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784584107.112982:0:18716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4912a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7aa expref: 19 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.112996:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:3.0:1784584107.112999:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584107.113003:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4912a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7aa expref: 19 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.113017:0:18716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983400, rc 0) 00000100:00100000:3.0:1784584107.113082:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+18:15634:x1871271580271104:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 313us (492us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1784584107.113089:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1784584107.116617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584107.116792:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580271360 00000100:00100000:1.0:1784584107.116802:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580271360 00000100:00100000:1.0:1784584107.116900:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584107.116911:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+18:15634:x1871271580271360:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784584107.117604:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+19:15634:x1871271580271360:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 693us (994us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1784584107.117613:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584107.154233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.154367:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580271616 00000100:00100000:2.0:1784584107.154377:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580271616 00000100:00100000:2.0:1784584107.154518:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:2.0:1784584107.154529:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+19:15637:x1871271580271616:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1784584107.154556:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584107.154578:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49138 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7b1 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.154685:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b400/0xdab2421a42e4913f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.154699:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b400/0xdab2421a42e4913f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.154711:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b400/0xdab2421a42e4913f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584107.154723:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784584107.154823:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49138 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b1 expref: 22 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.154842:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b400/0xdab2421a42e4913f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b1 expref: 21 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.154869:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.154872:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584107.154876:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b400, rc 0) 00000100:00100000:2.0:1784584107.154983:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:15637:x1871271580271616:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 456us (760us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784584107.154991:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:2.0:1784584107.158391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584107.158616:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580271744 00000100:00100000:3.0:1784584107.158627:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580271744 00000100:00100000:3.0:1784584107.159113:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784584107.159124:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:15637:x1871271580271744:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1784584107.159203:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159219:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159245:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159281:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159286:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159290:0:18716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159295:0:18716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584107.159299:0:18716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159306:0:18716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159317:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:3.0:1784584107.159320:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584107.159324:0:18716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584107.159331:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e4914d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584107.161370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584107.161510:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ef1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:15637:x1871271580271744:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 2384us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584107.161523:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:0.0:1784584107.161629:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580271872 00000100:00100000:0.0:1784584107.161638:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580271872 00000100:00100000:0.0:1784584107.161708:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584107.161715:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:2400:x1871271580271872:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584107.161732:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584107.161755:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b400/0xdab2421a42e4913f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b1 expref: 21 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.161772:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584107.161776:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584107.161815:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:2400:x1871271580271872:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 100us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584107.161821:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584107.164040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584107.164118:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580272128 00000100:00100000:0.0:1784584107.164127:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580272128 00000100:00100000:0.0:1784584107.164186:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1784584107.164196:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:15637:x1871271580272128:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1784584107.164395:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:15637:x1871271580272128:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 200us (364us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1784584107.164403:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584107.377279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584107.377434:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580272384 00000100:00100000:0.0:1784584107.377444:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580272384 00000100:00100000:0.0:1784584107.377547:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:0.0:1784584107.377567:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+21:15668:x1871271580272384:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1784584107.377591:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584107.377610:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e49154 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7b8 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.377745:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e4915b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.377761:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e4915b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.377772:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e4915b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584107.377784:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584107.377899:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e49154 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b8 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.377918:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e4915b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b8 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.377926:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584107.377930:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584107.377933:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8c00, rc 0) 00000100:00100000:0.0:1784584107.378280:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:15668:x1871271580272384:12345-192.168.203.51@tcp:101:cat.0 Request processed in 714us (1008us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784584107.378288:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784584107.386407:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584107.386458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.386682:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580272512 00000100:00100000:2.0:1784584107.386692:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580272512 00000100:00100000:2.0:1784584107.386771:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:2.0:1784584107.386781:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:2398:x1871271580272512:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584107.386797:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584107.386822:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e4915b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7b8 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.386840:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.386844:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584107.386900:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+22:2398:x1871271580272512:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 120us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.386907:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784584107.387339:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580272768 00000100:00100000:0.0:1784584107.387345:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580272768 00000100:00100000:0.0:1784584107.387395:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1784584107.387403:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+22:15668:x1871271580272768:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:0.0:1784584107.387890:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:15668:x1871271580272768:12345-192.168.203.51@tcp:35:cat.0 Request processed in 486us (1429us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1784584107.387913:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584107.456995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584107.457259:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273024 00000100:00100000:0.0:1784584107.457274:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273024 00000100:00100000:0.0:1784584107.457332:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:0.0:1784584107.457342:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:15674:x1871271580273024:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1784584107.457365:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584107.457383:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e49169 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7bf expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.457525:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.457540:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.457548:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 24 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.457998:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.458036:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 24 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.458050:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 24 pid: 17188 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584107.458064:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599214976:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584107.458871:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.458886:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584107.458897:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599215104:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784584107.458931:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584107.460005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584107.460341:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599214976:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584107.460728:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273152 00000100:00100000:2.0:1784584107.460735:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273152 00010000:00010000:2.0:1784584107.460773:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 25 pid: 17188 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584107.460835:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784584107.460845:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+25:2401:x1871271580273152:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584107.460859:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584107.460866:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 25 pid: 17188 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.460879:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 25 pid: 17188 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.460902:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1ca00/0xdab2421a42e49123 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7a3 expref: 25 pid: 17188 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.460917:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.460922:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.460930:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.460936:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584107.461056:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+24:2401:x1871271580273152:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 211us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.461064:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584107.462533:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584107.462855:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273280 00000100:00100000:1.0:1784584107.462863:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273280 00010000:00010000:1.0:1784584107.462900:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584107.462943:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1784584107.462953:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+24:2400:x1871271580273280:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584107.462968:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584107.462974:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.462988:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 24 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.463008:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:1.0:1784584107.463013:0:17171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.463023:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.463031:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584107.463063:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584107.463114:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43cb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+24:2400:x1871271580273280:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 162us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584107.463123:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00010000:00010000:0.0:1784584107.464946:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4910e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee79c expref: 23 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584107.464970:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1871271599215104:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584107.464995:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.465062:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.465069:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584107.465088:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584107.465250:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e49169 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7bf expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.465264:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7bf expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.465283:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584107.465286:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584107.465289:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8c00, rc 0) 00000100:00100000:0.0:1784584107.465345:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:15674:x1871271580273024:12345-192.168.203.51@tcp:101:dd.0 Request processed in 8004us (8356us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1784584107.465354:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1784584107.468527:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.468827:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273408 00000100:00100000:2.0:1784584107.468836:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273408 00000100:00100000:2.0:1784584107.468897:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:2.0:1784584107.468921:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+23:15674:x1871271580273408:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584107.468946:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584107.468965:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e4917e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7c6 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.468997:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.469011:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.469023:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.469135:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e4917e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 25 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.469166:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 24 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.469174:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.469177:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584107.469181:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ac00, rc 0) 00000100:00100000:2.0:1784584107.469280:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+24:15674:x1871271580273408:12345-192.168.203.51@tcp:101:dd.0 Request processed in 361us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.469287:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:3.0:1784584107.473139:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584107.473268:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273664 00000100:00100000:0.0:1784584107.473277:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273664 00000100:00100000:0.0:1784584107.473366:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:0.0:1784584107.473376:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+24:15674:x1871271580273664:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:0.0:1784584107.473632:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.473660:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.473671:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584107.473928:0:18716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784584107.473956:0:18716:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037faae2c reply state 00000000941c5342 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.473970:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584107.473978:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584107.473981:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784584107.473999:0:18716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584107.474088:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580273664:12345-192.168.203.51@tcp:36:dd.0 Request processed in 712us (956us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784584107.474096:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000020:00080000:0.0:1784584107.474101:0:18716:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784584107.476325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.476525:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580273792 00000100:00100000:2.0:1784584107.476535:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580273792 00000100:00100000:2.0:1784584107.476593:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1784584107.476614:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580273792:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584107.476643:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584107.476661:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7cd expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.476713:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7cd expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.476726:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7cd expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.476742:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.476745:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784584107.476748:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784584107.476799:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15674:x1871271580273792:12345-192.168.203.51@tcp:101:dd.0 Request processed in 187us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.476805:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:3.0:1784584107.489563:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.490753:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274048 00000100:00100000:2.0:1784584107.490764:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274048 00000100:00100000:2.0:1784584107.492234:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1784584107.492256:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15674:x1871271580274048:12345-192.168.203.51@tcp:103:dd.0 00010000:00010000:2.0:1784584107.492275:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584107.492303:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e49193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7cd expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.492322:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.492327:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584107.492416:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580274048:12345-192.168.203.51@tcp:103:dd.0 Request processed in 169us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.492424:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784584107.498585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.499290:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274176 00000100:00100000:2.0:1784584107.499300:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274176 00000100:00100000:2.0:1784584107.499354:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:2.0:1784584107.499362:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580274176:12345-192.168.203.51@tcp:58:dd.0 00010000:00010000:2.0:1784584107.499457:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.499492:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.499504:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584107.501593:0:17186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584107.501646:0:17186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1784584107.501812:0:17186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1784584107.501984:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580274176:12345-192.168.203.51@tcp:58:dd.0 Request processed in 2616us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.501995:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1784584107.508940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584107.509224:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274304 00000100:00100000:2.0:1784584107.509234:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274304 00000100:00100000:2.0:1784584107.509293:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:2.0:1784584107.509304:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+27:15674:x1871271580274304:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584107.509324:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584107.509343:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7d4 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509412:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509423:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509443:0:17188:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509454:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509503:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584107.509507:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784584107.509511:0:17188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 28 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584107.509519:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784584107.509578:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15674:x1871271580274304:12345-192.168.203.51@tcp:101:dd.0 Request processed in 275us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584107.509587:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000040:00080000:2.0:1784584107.566976:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584107.629754:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584108.077666:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784584108.077675:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584108.077701:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784584108.077713:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784584108.077867:0:17220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17220:1871271599215232:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584108.077977:0:17220:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584108.081429:0:17220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17220:1871271599215232:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784584108.083158:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.085119:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274432 00000100:00100000:0.0:1784584108.085132:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274432 00000100:00100000:0.0:1784584108.085228:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784584108.085240:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15675:x1871271580274432:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1784584108.085270:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1784584108.085274:0:18716:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784584108.085407:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30412a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15675:x1871271580274432:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 170us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.085415:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:1.0:1784584108.087967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.088622:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274560 00000100:00100000:0.0:1784584108.088632:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274560 00000100:00100000:0.0:1784584108.088691:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:0.0:1784584108.088700:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15675:x1871271580274560:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.088762:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088777:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088790:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088803:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088811:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088825:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.088991:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089003:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089011:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584108.089051:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784584108.089055:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584108.089066:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089077:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089084:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089091:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089096:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.089100:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089107:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089124:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b303986600) 00010000:00010000:0.0:1784584108.089127:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.089131:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089138:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089163:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089169:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089175:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089180:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.089183:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089189:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089195:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98b303986b00) 00010000:00010000:0.0:1784584108.089197:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.089200:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089206:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089227:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089233:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089239:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089244:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.089247:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089252:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089259:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584108.089261:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.089263:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.089269:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.089339:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15675:x1871271580274560:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 639us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.089346:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784584108.092981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.093090:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274816 00000100:00100000:2.0:1784584108.093100:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274816 00000100:00100000:2.0:1784584108.093164:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784584108.093174:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+28:15675:x1871271580274816:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584108.093196:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584108.093217:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e491bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7db expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093325:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093341:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093352:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584108.093364:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784584108.093448:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093456:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093463:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093508:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584108.093525:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093534:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093546:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584108.093549:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784584108.093553:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093560:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093602:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e491bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7db expref: 30 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093613:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b303986600) 00010000:00010000:2.0:1784584108.093616:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584108.093620:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e491bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7db expref: 30 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.093630:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784584108.093690:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+29:15675:x1871271580274816:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 518us (847us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1784584108.093698:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:1.0:1784584108.097348:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.097665:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580274944 00000100:00100000:2.0:1784584108.097675:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580274944 00000100:00100000:2.0:1784584108.097737:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:2.0:1784584108.097747:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+29:15675:x1871271580274944:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784584108.097793:0:17188:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784584108.098249:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+29:15675:x1871271580274944:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 501us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.098257:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1784584108.101548:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.101616:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275200 00000100:00100000:2.0:1784584108.101625:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275200 00000100:00100000:2.0:1784584108.101696:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1784584108.101706:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+29:15675:x1871271580275200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584108.101730:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584108.101750:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e491d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7e2 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584108.102639:0:17186:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1784584108.102649:0:17186:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1784584108.102671:0:17186:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1784584108.102953:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.102969:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.103032:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.103095:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7b800/0xdab2421a42e491d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e2 expref: 32 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.103110:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e2 expref: 31 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.103125:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b403a0e600) 00010000:00010000:2.0:1784584108.103127:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584108.103129:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a000, rc 0) 00000100:00100000:2.0:1784584108.103265:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+31:15675:x1871271580275200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1560us (1724us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1784584108.103274:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1784584108.108105:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.108273:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275456 00000100:00100000:0.0:1784584108.108283:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275456 00000100:00100000:0.0:1784584108.108387:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:0.0:1784584108.108410:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+31:15675:x1871271580275456:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.108506:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584108.108533:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a000/0xdab2421a42e491d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e2 expref: 31 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108552:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b403a0e600) 00010000:00010000:0.0:1784584108.108563:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584108.108598:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108611:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108621:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108646:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108654:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108661:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108705:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108712:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108729:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108735:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.108739:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108747:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108756:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:0.0:1784584108.108759:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.108763:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108768:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e491e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108778:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108784:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108789:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108806:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.108810:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108826:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108834:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe10b8fb9 (ffff98b303986b00) 00010000:00010000:0.0:1784584108.108837:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.108839:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.108844:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e491ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe10b8fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.108915:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+30:15675:x1871271580275456:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 506us (819us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784584108.108923:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:1.0:1784584108.111951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.112167:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275584 00000100:00100000:0.0:1784584108.112176:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275584 00000100:00100000:0.0:1784584108.112234:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1784584108.112243:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+30:15675:x1871271580275584:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.112264:0:18716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584108.112284:0:18716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7e9 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.112318:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e491fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.112331:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e491fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.112342:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e491fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.112465:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e491f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e9 expref: 32 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.113877:0:18716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e491fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e9 expref: 31 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.113887:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:0.0:1784584108.113890:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584108.113893:0:18716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9600, rc 0) 00000100:00100000:0.0:1784584108.114186:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+31:15675:x1871271580275584:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1942us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.114195:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:3.0:1784584108.116848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.116888:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.116964:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275840 00000100:00100000:2.0:1784584108.116974:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275840 00000100:00100000:2.0:1784584108.117062:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:2.0:1784584108.117073:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580275840:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784584108.117426:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276096 00000100:00100000:0.0:1784584108.117432:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276096 00000100:00100000:0.0:1784584108.117485:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:0.0:1784584108.117494:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580276096:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584108.117578:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580275840:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 506us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.117587:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00080000:2.0:1784584108.117631:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584108.117636:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584108.118027:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118079:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276608 00000100:00100000:3.0:1784584108.118082:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276608 00000100:00100000:3.0:1784584108.118115:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1784584108.118122:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276608:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.118164:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276608:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.118171:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00080000:3.0:1784584108.118234:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584108.118263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118288:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275712 00000100:00100000:3.0:1784584108.118304:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275712 00000100:00100000:3.0:1784584108.118332:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:3.0:1784584108.118338:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2399:x1871271580275712:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.118364:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2399:x1871271580275712:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.118371:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:3.0:1784584108.118425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118443:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580275968 00000100:00100000:3.0:1784584108.118447:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580275968 00000100:00100000:3.0:1784584108.118496:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1784584108.118503:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580275968:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.118529:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580275968:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.118535:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00080000:3.0:1784584108.118550:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584108.118836:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118919:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.118936:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276480 00000100:00100000:3.0:1784584108.118940:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276480 00000100:00100000:3.0:1784584108.118969:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584108.118974:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276480:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.119092:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276480:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 117us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.119101:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00080000:3.0:1784584108.119120:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584108.119130:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276352 00000100:00100000:3.0:1784584108.119151:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276352 00000100:00100000:3.0:1784584108.119184:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276224 00000100:00100000:3.0:1784584108.119187:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276224 00000100:00100000:3.0:1784584108.119207:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1784584108.119213:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276352:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.119238:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2399:x1871271580276352:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.119244:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1784584108.119255:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1784584108.119260:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+12:2399:x1871271580276224:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584108.119282:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec83902b-e7e6-476f-9537-00c010e7ce56+12:2399:x1871271580276224:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.119288:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00080000:3.0:1784584108.119302:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584108.119305:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784584108.119809:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2399:x1871271580276096:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 2313us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.119819:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1784584108.124781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.124874:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276864 00000100:00100000:3.0:1784584108.124886:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276864 00000100:00100000:3.0:1784584108.125010:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1784584108.125021:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+31:15675:x1871271580276864:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584108.125098:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.125116:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.125127:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584108.125321:0:18716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1784584108.125330:0:18716:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551310862098ns, next at 552310859749ns, rc = 0 00000004:00010000:3.0:1784584108.125375:0:18716:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027b3a13e reply state 00000000640b5bc4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.125385:0:18716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.125391:0:18716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:3.0:1784584108.125393:0:18716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784584108.125395:0:18716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584108.125516:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+33:15675:x1871271580276864:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 497us (746us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784584108.125523:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1784584108.127544:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.127822:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580276992 00000100:00100000:0.0:1784584108.127831:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580276992 00000100:00100000:0.0:1784584108.127887:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1784584108.127896:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+33:15675:x1871271580276992:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.127919:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584108.127937:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7f0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.128012:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 34 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.128028:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 34 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.128046:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:0.0:1784584108.128049:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584108.128053:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8e00, rc 0) 00000100:00100000:0.0:1784584108.128110:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+34:15675:x1871271580276992:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 215us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.128117:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1784584108.131980:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.132284:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580277120 00000100:00100000:3.0:1784584108.132294:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580277120 00000100:00100000:3.0:1784584108.132939:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1784584108.132958:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580277120:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784584108.133449:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2401:x1871271580277120:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 495us (1477us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1784584108.133458:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1784584108.140222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.141876:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580277376 00000100:00100000:2.0:1784584108.141889:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580277376 00000100:00100000:2.0:1784584108.141953:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784584108.141963:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+34:15675:x1871271580277376:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584108.142197:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+35:15675:x1871271580277376:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 235us (1983us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784584108.142205:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784584108.146311:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.147131:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580277632 00000100:00100000:3.0:1784584108.147155:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580277632 00000100:00100000:3.0:1784584108.147268:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1784584108.147279:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+35:15675:x1871271580277632:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784584108.147408:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+35:15675:x1871271580277632:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 131us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.147416:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:1.0:1784584108.151663:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.151753:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580277760 00000100:00100000:0.0:1784584108.151763:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580277760 00000100:00100000:0.0:1784584108.151876:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:0.0:1784584108.151886:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+35:15675:x1871271580277760:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.151905:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584108.151924:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49211 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7f7 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152011:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152025:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152037:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584108.152087:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584108.152105:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152129:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49211 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f7 expref: 37 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152157:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f7 expref: 36 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.152165:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:0.0:1784584108.152168:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784584108.152172:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9000, rc 0) 00000100:00100000:0.0:1784584108.152237:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+36:15675:x1871271580277760:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 352us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.152244:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:1.0:1784584108.156661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.156716:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580277888 00000100:00100000:2.0:1784584108.156748:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580277888 00000100:00100000:2.0:1784584108.156838:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584108.156846:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2398:x1871271580277888:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584108.156861:0:19378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584108.156877:0:19378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee7fe expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584108.156897:0:19378:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e97ac, blocks: 0x0 00010000:00010000:2.0:1784584108.156912:0:19378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1784584108.156916:0:19378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584108.156923:0:19378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 7 pid: 19378 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.156948:0:19378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 7 pid: 19378 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.156961:0:19378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784584108.157014:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:2398:x1871271580277888:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 169us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.157022:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784584108.162706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.166151:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278144 00000100:00100000:0.0:1784584108.166166:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278144 00000100:00100000:0.0:1784584108.166286:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:0.0:1784584108.166297:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+36:15675:x1871271580278144:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784584108.166417:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+36:15675:x1871271580278144:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 109us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.166425:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1784584108.173347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.173425:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278272 00000100:00100000:2.0:1784584108.173434:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278272 00000100:00100000:2.0:1784584108.173510:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1784584108.173520:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+36:15675:x1871271580278272:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784584108.176814:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1784584108.176830:0:17166:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784584108.176884:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1784584108.176987:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599215360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784584108.177005:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+19:15675:x1871271580278272:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 3486us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584108.177014:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1784584108.177044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.177089:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599215360 00000100:00100000:2.0:1784584108.177095:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599215360 00000100:00100000:2.0:1784584108.177147:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584108.177158:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599215360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1784584108.177276:0:18694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784584108.177280:0:18694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784584108.177282:0:18694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784584108.177284:0:18694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784584108 -> 1784584108 00002000:00010000:2.0:1784584108.177287:0:18694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784584108.177318:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1871271599215360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (273us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784584108.177324:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784584108.177340:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1784584108.177368:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43c8ed500/2, rc 0, transno 8589934596 00000100:00100000:2.0:1784584108.177373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599215360:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1784584108.177591:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177602:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177615:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177622:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.177626:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177635:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177660:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:0.0:1784584108.177663:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1784584108.177668:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.177675:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983c00/0xdab2421a42e490ac lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177903:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177911:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177916:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177920:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584108.177922:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177927:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177935:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98b403a0e400) 00010000:00010000:3.0:1784584108.177938:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584108.177941:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177947:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49058 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177961:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177977:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177983:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177988:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584108.177991:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.177996:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178004:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:3.0:1784584108.178006:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584108.178009:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178015:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0400/0xdab2421a42e4905f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178027:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178033:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178038:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178044:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584108.178054:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178060:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178069:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98b303986000) 00010000:00010000:3.0:1784584108.178071:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584108.178074:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178079:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49107 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178094:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178098:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178659:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178664:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8800 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584108.178667:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178673:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178681:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:3.0:1784584108.178684:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584108.178692:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178698:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8800/0xdab2421a42e4918c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178711:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178718:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178723:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178728:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584108.178730:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178736:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178744:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:3.0:1784584108.178746:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784584108.178749:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.178754:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49203 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584108.178838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.178895:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278400 00000100:00100000:0.0:1784584108.178902:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278400 00000100:00100000:0.0:1784584108.178942:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784584108.178950:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:2401:x1871271580278400:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784584108.179022:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:2401:x1871271580278400:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.179029:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1784584108.181024:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584108.181085:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278656 00000100:00100000:3.0:1784584108.181092:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278656 00000100:00100000:3.0:1784584108.181147:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:3.0:1784584108.181167:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+15:15675:x1871271580278656:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584108.181215:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584108.181238:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49218 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f7 expref: 15 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.181256:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:3.0:1784584108.181260:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584108.181285:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.181298:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.181308:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584108.183788:0:17188:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f43538b7 reply state 00000000ac9512ac transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.183815:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.183824:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:2.0:1784584108.183827:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784584108.183830:0:17188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784584108.184050:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:15675:x1871271580278656:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 2879us (3028us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1784584108.184059:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:1.0:1784584108.189012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.189123:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278784 00000100:00100000:2.0:1784584108.189133:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278784 00000100:00100000:2.0:1784584108.189231:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1784584108.189241:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+7:2398:x1871271580278784:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784584108.189394:0:18694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784584108.189398:0:18694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784584107 00002000:00010000:2.0:1784584108.189400:0:18694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784584107 00002000:00010000:2.0:1784584108.189402:0:18694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784584108 -> 1784584107 00002000:00010000:2.0:1784584108.189404:0:18694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784584108.189568:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+8:2398:x1871271580278784:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 328us (565us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784584108.189577:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1784584108.193984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.194077:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580278912 00000100:00100000:0.0:1784584108.194087:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580278912 00000100:00100000:0.0:1784584108.194150:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:0.0:1784584108.194163:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b406373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+8:2400:x1871271580278912:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.194218:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194234:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584108.194239:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584108.194245:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194258:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194282:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194290:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194298:0:18692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194304:0:18692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584108.194308:0:18692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194316:0:18692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194343:0:18692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.194352:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa3c29b/0xdab2421a42e4922d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.194508:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b406373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+8:2400:x1871271580278912:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 307us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.194516:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784584108.196125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584108.196213:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279168 00000100:00100000:0.0:1784584108.196221:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279168 00000100:00100000:0.0:1784584108.196355:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:0.0:1784584108.196365:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:15675:x1871271580279168:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784584108.196442:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.196459:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 16 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.196499:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.196532:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 16 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.196546:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 16 pid: 17188 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.196567:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599215488:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784584108.196633:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584108.198873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.198952:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279296 00000100:00100000:2.0:1784584108.198959:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279296 00010000:00010000:2.0:1784584108.198995:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 17 pid: 17188 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.199031:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599215488:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584108.199032:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584108.199041:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+17:2401:x1871271580279296:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584108.199052:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584108.199053:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199059:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 17 pid: 17188 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199069:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 17 pid: 17188 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199106:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49185 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7c6 expref: 17 pid: 17188 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199120:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584108.199129:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 16 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199147:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199155:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199162:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.199189:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584108.199229:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:2401:x1871271580279296:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.199245:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:0.0:1784584108.199404:0:17187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.199412:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.199955:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.199967:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.199980:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.200007:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.200019:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 16 pid: 17187 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.200032:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599215616:192.168.203.51@tcp:104: 00000100:00100000:0.0:1784584108.200131:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584108.201840:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599215616:192.168.203.51@tcp:104: 00010000:00010000:0.0:1784584108.201864:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584108.202663:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.202724:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279424 00000100:00100000:2.0:1784584108.202731:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279424 00010000:00010000:2.0:1784584108.202772:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 17 pid: 17187 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584108.202810:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784584108.202819:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+17:2400:x1871271580279424:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584108.202845:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584108.202852:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 17 pid: 17187 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202864:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 17 pid: 17187 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202885:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4920a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7f0 expref: 17 pid: 17187 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202901:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:2.0:1784584108.202905:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202914:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202922:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.202948:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584108.202998:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:2400:x1871271580279424:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 180us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.203006:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00010000:00010000:0.0:1784584108.203055:0:17187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.203063:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584108.203167:0:17187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1784584108.203278:0:17187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1784584108.203314:0:17187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1784584108.203382:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17187:1871271599215744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784584108.203438:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584108.203503:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584108.203722:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599215744 00000100:00100000:2.0:1784584108.203728:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599215744 00000100:00100000:2.0:1784584108.203773:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784584108.203781:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17187:x1871271599215744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784584108.203853:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17187:x1871271599215744:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.203866:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784584108.204004:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17187:1871271599215744:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1784584108.204118:0:17187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1784584108.204162:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17187:1871271599215872:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784584108.204190:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584108.204211:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a6fd840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584108.204293:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599215872 00000100:00100000:2.0:1784584108.204298:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599215872 00000100:00100000:2.0:1784584108.204360:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584108.204367:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17187:x1871271599215872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784584108.204487:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17187:x1871271599215872:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (275us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1784584108.204494:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784584108.204639:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17187:1871271599215872:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784584108.204668:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204678:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204697:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204703:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.204707:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204715:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204728:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:0.0:1784584108.204731:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584108.204735:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204801:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8400/0xdab2421a42e4923b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204831:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204838:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204844:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204849:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7bc00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.204851:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204867:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204876:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584108.204879:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584108.204885:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 19 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204895:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 19 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204904:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 19 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.204949:0:17187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 19 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.204960:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599216000:192.168.203.51@tcp:105: 00000100:00100000:0.0:1784584108.205105:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584108.205772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584108.205805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584108.205840:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216128 00000100:00100000:0.0:1784584108.205845:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216128 00000100:00100000:0.0:1784584108.205879:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584108.205886:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871271599216128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584108.205907:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784584108.205958:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871271599216128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584108.205964:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584108.205996:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584108.206102:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599216384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784584108.206129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584108.206163:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599216896:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206172:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599216256:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.206184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584108.206200:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599217408:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206220:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599216768:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.206221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206241:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599216640:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206278:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599217152:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206296:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206311:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599217664:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206344:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599216512:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206382:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599217024:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.206417:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599217536:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206440:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216640 00000100:00100000:2.0:1784584108.206443:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216640 00000100:00100000:2.0:1784584108.206503:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217152 00000100:00100000:2.0:1784584108.206507:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217152 00000100:00100000:2.0:1784584108.206520:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217024 00000100:00100000:2.0:1784584108.206522:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217024 00000100:00100000:2.0:1784584108.206535:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584108.206541:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599216640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206577:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599216640:12345-0@lo:400:kworker.0 Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.206585:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584108.206597:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584108.206602:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599217152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206628:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599217152:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.206634:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584108.206644:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584108.206649:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.206677:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599217024:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.206682:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1784584108.206698:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584108.206702:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584108.206831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584108.206861:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599216640:0@lo:400:kworker.0 00000100:00100000:0.0:1784584108.206871:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599217152:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207016:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217408 00000100:00100000:2.0:1784584108.207020:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217408 00000100:00100000:2.0:1784584108.207057:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217664 00000100:00100000:2.0:1784584108.207060:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217664 00000100:00100000:2.0:1784584108.207074:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584108.207080:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599217408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207111:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599217408:12345-0@lo:400:kworker.0 Request processed in 32us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207124:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584108.207136:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584108.207137:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599217408:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207154:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599217664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.207173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.207183:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599217664:12345-0@lo:400:kworker.0 Request processed in 42us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584108.207186:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599217280:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207189:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784584108.207198:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216768 00000100:00100000:2.0:1784584108.207200:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216768 00000100:00100000:1.0:1784584108.207206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.207211:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217280 00000100:00100000:2.0:1784584108.207213:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217280 00000100:00100000:1.0:1784584108.207215:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599217792:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207223:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784584108.207227:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599216768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207253:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599216768:12345-0@lo:400:kworker.0 Request processed in 25us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207258:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784584108.207268:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784584108.207274:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207299:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599217280:12345-0@lo:400:kworker.0 Request processed in 25us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207304:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784584108.207349:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584108.207369:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599217664:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207665:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216256 00000100:00100000:2.0:1784584108.207669:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216256 00000100:00100000:2.0:1784584108.207703:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784584108.207709:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599216256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207749:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599216256:12345-0@lo:400:kworker.0 Request processed in 31us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207766:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784584108.207794:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216896 00000100:00100000:2.0:1784584108.207797:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216896 00000100:00100000:2.0:1784584108.207818:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216512 00000100:00100000:2.0:1784584108.207821:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216512 00000100:00100000:2.0:1784584108.207833:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584108.207839:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207876:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599216896:12345-0@lo:400:kworker.0 Request processed in 36us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207882:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584108.207894:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784584108.207901:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.207919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584108.207945:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599216512:12345-0@lo:400:kworker.0 Request processed in 44us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.207952:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584108.207962:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599216256:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.207975:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217792 00000100:00100000:2.0:1784584108.207980:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217792 00000100:00100000:1.0:1784584108.207981:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599216768:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.207996:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599217280:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.208011:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784584108.208019:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599217792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.208028:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599216384 00000100:00100000:1.0:1784584108.208034:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599216384 00000100:00100000:2.0:1784584108.208064:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599217792:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584108.208070:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784584108.208075:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784584108.208082:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599216384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784584108.208100:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784584108.208134:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599216384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (2003us total) trans 0 rc 0/0 00000100:00080000:0.0:1784584108.208138:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784584108.208161:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584108.208195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584108.208463:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599216512:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.208497:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599217024:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.208528:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217536 00000100:00100000:2.0:1784584108.208533:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217536 00000100:00100000:1.0:1784584108.208541:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599216896:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.208558:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599216384:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1784584108.208588:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43c8eea00 x1871271599217792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584108.208600:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599217792:0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.208604:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584108.208614:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599217536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584108.208667:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599217536:12345-0@lo:400:kworker.0 Request processed in 55us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.208673:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1784584108.208735:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43c8ec380 x1871271599217536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584108.208745:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599217536:0@lo:400:kworker.0 00000100:00100000:1.0:1784584108.209086:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599217920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584108.209115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584108.209221:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599217920 00000100:00100000:3.0:1784584108.209230:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599217920 00000100:00100000:3.0:1784584108.209283:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1784584108.209285:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584108.209290:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599217920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584108.209306:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784584108.209355:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599217920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.209361:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584108.209365:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599217920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584108.211230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.211284:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279552 00000100:00100000:2.0:1784584108.211291:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279552 00000100:00100000:0.0:1784584108.211321:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17187:1871271599216000:192.168.203.51@tcp:105: 00000100:00100000:2.0:1784584108.211340:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00010000:00010000:0.0:1784584108.211344:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584108.211347:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43e694450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:15674:x1871271580279552:12345-192.168.203.51@tcp:49:dd.0 00010000:00010000:0.0:1784584108.211354:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7bc00/0xdab2421a42e4919a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211383:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211395:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211404:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211413:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211431:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211437:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211442:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.211446:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211453:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211465:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584108.211482:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584108.211486:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211492:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8200/0xdab2421a42e49242 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211506:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211512:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211519:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211524:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584108.211533:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211540:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211549:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:0.0:1784584108.211551:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584108.211554:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.211560:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9400/0xdab2421a42e49234 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584108.211673:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43e694450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:15674:x1871271580279552:12345-192.168.203.51@tcp:49:dd.0 Request processed in 322us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.211681:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784584108.211727:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+19:15675:x1871271580279168:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 15363us (15606us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1784584108.211735:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000020:00080000:0.0:1784584108.211748:0:17187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784584108.213066:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584108.213073:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584108.213095:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784584108.213100:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784584108.214612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584108.214666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.214721:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279680 00000100:00100000:2.0:1784584108.214730:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279680 00000100:00100000:2.0:1784584108.214784:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:2.0:1784584108.214793:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+19:15674:x1871271580279680:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584108.214812:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584108.214830:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49249 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee805 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.214862:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e49250 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.214876:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e49250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.214887:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e49250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.215019:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7ac00/0xdab2421a42e49249 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee805 expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.215036:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e49250 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee805 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.215042:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:2.0:1784584108.215044:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584108.215046:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a400, rc 0) 00000100:00100000:2.0:1784584108.215090:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:15674:x1871271580279680:12345-192.168.203.51@tcp:101:dd.0 Request processed in 299us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584108.215098:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:3.0:1784584108.215162:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580279936 00000100:00100000:3.0:1784584108.215167:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580279936 00000100:00100000:3.0:1784584108.215199:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1784584108.215205:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+20:15675:x1871271580279936:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784584108.215397:0:17189:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784584108.215425:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1784584108.215447:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215458:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215814:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215824:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215830:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215836:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.215887:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784584108.215959:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+22:15675:x1871271580279936:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 752us (1290us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1784584108.215967:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000020:00080000:3.0:1784584108.215971:0:17189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784584108.219581:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584108.219595:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.219605:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584108.219609:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.219618:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.219636:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:2.0:1784584108.219639:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784584108.219766:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.219791:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418983400/0xdab2421a42e49257 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.219808:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584108.219810:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584108.219812:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584108.367741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584108.367788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.372366:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280064 00000100:00100000:2.0:1784584108.372382:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280064 00000100:00100000:2.0:1784584108.372500:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280192 00000100:00100000:2.0:1784584108.372505:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280192 00000100:00100000:2.0:1784584108.372531:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584108.372541:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:2400:x1871271580280064:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:2.0:1784584108.372577:0:18697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.372603:0:18697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 9 pid: 19378 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.372613:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584108.372618:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584108.372623:0:18697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.372659:0:18697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 9 pid: 19378 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.372673:0:18697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 9 pid: 19378 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584108.372701:0:18697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18697:1871271599218048:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584108.372882:0:18697:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43ea58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584108.380027:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584108.380159:0:18697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18697:1871271599218048:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584108.380185:0:18697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584108.380317:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280320 00000100:00100000:3.0:1784584108.380324:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280320 00010000:00010000:3.0:1784584108.380358:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 10 pid: 19378 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584108.380398:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784584108.380421:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+10:2400:x1871271580280320:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584108.380436:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584108.380458:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 10 pid: 19378 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.380602:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 10 pid: 19378 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.380684:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3def5b1/0xdab2421a42e4921f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7fe expref: 10 pid: 19378 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.380702:0:17173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584108.380707:0:17173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584108.380713:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.380722:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584108.380792:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584108.380851:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+9:2400:x1871271580280320:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 431us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584108.380859:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00010000:00010000:2.0:1784584108.383264:0:18697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584108.383283:0:18697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584108.519136:0:19508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1784584108.519165:0:19508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1784584108.529906:0:18697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1784584108.529915:0:18697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1784584107 -> 1784584108 00002000:00010000:0.0:1784584108.529918:0:18697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784584107 -> 1784584108 00002000:00010000:0.0:1784584108.529920:0:18697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1784584108.529938:0:18697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.529952:0:18697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.529960:0:18697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.529983:0:18697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ac00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584108.529989:0:18697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.529997:0:18697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.530014:0:18697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.530021:0:18697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575643eb/0xdab2421a42e4925e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.530130:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+6:2400:x1871271580280064:12345-192.168.203.51@tcp:4:dd.0 Request processed in 157585us (162393us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784584108.530149:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584108.530183:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784584108.530194:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2400:x1871271580280192:12345-192.168.203.51@tcp:4:dd.0 00002000:00010000:0.0:1784584108.530230:0:18697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a5e97ac, atime: 0x6a5e97ab, ctime: 0x6a5e97ac, blocks: 0x2000 00010000:00010000:0.0:1784584108.530237:0:18697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.530248:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1784584108.530252:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584108.530258:0:18697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.530275:0:18697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584108.585727:0:19508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1784584108.585994:0:18697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1784584108.585999:0:18697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1784584108.586014:0:18697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586027:0:18697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586036:0:18697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586043:0:18697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584108.586048:0:18697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586056:0:18697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586075:0:18697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584108.586082:0:18697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bcaf49/0xdab2421a42e49265 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584108.586199:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2400:x1871271580280192:12345-192.168.203.51@tcp:4:dd.0 Request processed in 56004us (218410us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784584108.586210:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00010000:00010000:2.0:1784584108.658075:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584109.229762:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584109.229771:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584109.229802:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784584109.229811:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1784584109.679112:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584109.886246:0:20363:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1784584110.702940:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584110.765819:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599218176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784584110.765885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584110.765972:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218176 00000100:00100000:2.0:1784584110.765980:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218176 00000100:00100000:2.0:1784584110.766036:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584110.766046:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599218176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784584110.766084:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584110.766139:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599218176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584110.766147:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1784584110.766200:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584110.766233:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599218176:0@lo:13:osp-pre-0-1.0 Debug log: 41508 lines, 41508 kept, 0 dropped, 0 bad.